00000040:00080000:3.0F:1788925146.539896:0:17103:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788925146.539921:0:17103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788925146.539945:0:17103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788925146.539952:0:17103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0F:1788925146.669079:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0F:1788925146.809227:0:17049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934634 is committed 00000020:00080000:1.0:1788925146.809274:0:17049:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff97a62185fc00 refcount 2 committed 0 result 0 batchid 4294967531 00000020:00080000:1.0:1788925146.809281:0:17049:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a610d7d600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff97a635961240 00000020:00080000:1.0:1788925146.809285:0:17049:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff97a610d7d000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff97a62e2d5a00 00000020:00080000:3.0:1788925146.809654:0:17109:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967531 committed batchid 8 00000020:00080000:3.0:1788925146.809745:0:17109:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1788925146.810489:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810506:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810515:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810521:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925146.810526:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810534:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810553:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a503701a00) 00010000:00010000:2.0:1788925146.810565:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925146.810572:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925146.810579:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985400/0x45e32cfaf74239af lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17071 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925147.312541:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925147.312561:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470801280:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925147.312626:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788925147.313247:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801280 00000100:00100000:0.0:1788925147.313262:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801280 00000100:00100000:0.0:1788925147.313326:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925147.313336:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470801280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925147.313362:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925147.313423:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503928e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470801280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925147.313430:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:1.0:1788925147.313617:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925147.313652:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470801280:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925147.691904:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925148.721747:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925149.742345:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925149.939340:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939380:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939433:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939465:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939489:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939516:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925149.939544:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333184 00000100:00100000:0.0:1788925149.939557:0:17071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333184 00000100:00100000:2.0:1788925149.939697:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333440 00000100:00100000:2.0:1788925149.939702:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333440 00000100:00100000:0.0:1788925149.939760:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333056 00000100:00100000:0.0:1788925149.939764:0:17071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333056 00000100:00100000:1.0:1788925149.939832:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462332928 00000100:00100000:1.0:1788925149.939837:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462332928 00000100:00100000:1.0:1788925149.939887:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00100000:1.0:1788925149.939899:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a8830b-9008-47f6-b758-a6b6e99b091b+13:2389:x1875823462332928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925149.939996:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:54a8830b-9008-47f6-b758-a6b6e99b091b+13:2389:x1875823462332928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 99us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925149.940004:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 174 00000100:00080000:1.0:1788925149.940039:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925149.940044:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788925149.946269:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333568 00000100:00100000:2.0:1788925149.946291:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333568 00000100:00100000:2.0:1788925149.946489:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1788925149.946504:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:2389:x1875823462333184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925149.946637:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:2389:x1875823462333184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 136us (7254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925149.946645:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 90 00000100:00100000:2.0:1788925149.946669:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1788925149.946676:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2389:x1875823462333440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925149.946703:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2389:x1875823462333440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (7270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925149.946708:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 91 00000100:00100000:2.0:1788925149.946723:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1788925149.946729:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2389:x1875823462333568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925149.946752:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2389:x1875823462333568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 23us (7236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925149.946758:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 92 00000100:00100000:2.0:1788925149.946797:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333312 00000100:00100000:2.0:1788925149.946803:0:18576:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333312 00000100:00100000:0.0:1788925149.949362:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00100000:0.0:1788925149.949384:0:17071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:2389:x1875823462333056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925149.949502:0:17071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:2389:x1875823462333056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 127us (10047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925149.949510:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 93 00000100:00080000:1.0:1788925149.955379:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788925149.955396:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788925149.957420:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:2.0:1788925149.957441:0:18576:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+6:2389:x1875823462333312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925149.957552:0:18576:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+6:2389:x1875823462333312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 118us (18061us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925149.957560:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1788925150.379286:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470801536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925150.379388:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925150.379486:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50392b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470801408:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925150.379513:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925150.379559:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801408 00000100:00100000:1.0:1788925150.379569:0:17811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801408 00000100:00100000:1.0:1788925150.379631:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925150.379654:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470801408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788925150.379704:0:17811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788925150.379763:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470801408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925150.379770:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925150.379833:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50392b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470801408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925150.381306:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5042e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470801664:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788925150.381306:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a503ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470801792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925150.381420:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925150.381500:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801536 00000100:00100000:3.0:1788925150.381508:0:18580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801536 00000100:00100000:3.0:1788925150.381554:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801664 00000100:00100000:3.0:1788925150.381557:0:18580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801664 00000100:00100000:3.0:1788925150.381574:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925150.381582:0:18580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470801536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788925150.381614:0:18580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788925150.381659:0:18580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470801536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 77us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925150.381665:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925150.381683:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925150.381688:0:18580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5042e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470801664:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788925150.381721:0:18580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:3.0:1788925150.381751:0:18580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5042e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470801664:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925150.381757:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925150.381795:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5042e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470801664:0@lo:13:osp-pre-1-1.0 00000100:00080000:2.0:1788925150.385483:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925150.385496:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925150.386249:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470801920:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.386380:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.386488:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470802432:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.386623:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.386682:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470802944:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.386723:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.386773:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788925150.386781:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470802048:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.386950:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.387649:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470802560:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.387685:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.387704:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470803072:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.387725:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925150.387769:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801920 00000100:00100000:2.0:1788925150.387778:0:17064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801920 00000100:00100000:3.0:1788925150.388447:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470802176:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.388500:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925150.388530:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470802688:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.388664:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788925150.388675:0:17064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3623:x1875823470801920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.388732:0:17064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3623:x1875823470801920:12345-0@lo:400:kworker.0 Request processed in 60us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.388738:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788925150.388775:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802432 00000100:00100000:2.0:1788925150.388780:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802432 00000100:00100000:2.0:1788925150.389677:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802944 00000100:00100000:2.0:1788925150.389688:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802944 00000100:00100000:2.0:1788925150.389733:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802560 00000100:00100000:2.0:1788925150.389737:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802560 00000100:00100000:2.0:1788925150.389750:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803072 00000100:00100000:2.0:1788925150.389752:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803072 00000100:00100000:2.0:1788925150.389769:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788925150.389777:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470802432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.389943:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925150.389982:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788925150.389991:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470802304:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.390019:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925150.390042:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470802816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.390061:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925150.390064:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925150.390099:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470801792 00000100:00100000:1.0:1788925150.390104:0:18580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470801792 00000100:00100000:1.0:1788925150.390154:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925150.390162:0:18580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470801792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925150.390184:0:18580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788925150.390224:0:18580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470801792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925150.390230:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925150.390297:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a503ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470801792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925150.390341:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802176 00000100:00100000:3.0:1788925150.390346:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802176 00000100:00100000:3.0:1788925150.390384:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802304 00000100:00100000:3.0:1788925150.390388:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802304 00000100:00100000:3.0:1788925150.390433:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925150.390440:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5042e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470802176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.390491:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5042e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470802176:12345-0@lo:400:kworker.0 Request processed in 52us (1991us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925150.390497:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925150.390512:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925150.390517:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5042e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470802304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.390658:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470802432:12345-0@lo:400:kworker.0 Request processed in 882us (4034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.390665:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788925150.390679:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802688 00000100:00100000:2.0:1788925150.390682:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802688 00000100:00100000:2.0:1788925150.390697:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802816 00000100:00100000:2.0:1788925150.390700:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802816 00000100:00100000:2.0:1788925150.390712:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788925150.390718:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470802944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.390746:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470802944:12345-0@lo:400:kworker.0 Request processed in 29us (4023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.390752:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788925150.390761:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788925150.390766:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470802560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.390790:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470802560:12345-0@lo:400:kworker.0 Request processed in 24us (3105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.390795:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788925150.391003:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5042e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470802304:12345-0@lo:400:kworker.0 Request processed in 485us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925150.391010:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925150.391097:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470802304:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.391109:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470802176:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.391388:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788925150.391395:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470803072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.391502:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470803072:12345-0@lo:400:kworker.0 Request processed in 108us (3776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.391508:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788925150.391520:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925150.391526:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5042e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470802688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.393471:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5042e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470802688:12345-0@lo:400:kworker.0 Request processed in 1924us (3507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.394272:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925150.394322:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788925150.394337:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5042e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470802816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.394438:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5042e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470802816:12345-0@lo:400:kworker.0 Request processed in 108us (4375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925150.394445:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788925150.394486:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470802048 00000100:00100000:2.0:1788925150.394495:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470802048 00010000:00080000:3.0:1788925150.394679:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a602c90700 x1875823470802816/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925150.394696:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470802816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.394722:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470802688:0@lo:400:kworker.0 00000100:00100000:3.0:1788925150.396228:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470801536:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925150.396390:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788925150.396422:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470802048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.396440:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470802560:0@lo:400:kworker.0 00010000:00080000:2.0:1788925150.396468:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a602c90000 x1875823470803072/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925166 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925150.396479:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470803072:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.396491:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470801920:0@lo:400:kworker.0 00000100:00100000:1.0:1788925150.396524:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470802048:12345-0@lo:400:kworker.0 Request processed in 123us (9572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925150.396532:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788925150.397229:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470802432:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.397261:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470802944:0@lo:400:kworker.0 00000100:00100000:2.0:1788925150.397298:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470802048:0@lo:400:kworker.0 00000100:00080000:2.0:1788925150.397323:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788925150.397329:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788925150.397333:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788925150.397337:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788925150.777873:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925150.902191:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925150.920825:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a503ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470803200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788925150.920935:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925150.921578:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803200 00000100:00100000:3.0:1788925150.921589:0:17074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803200 00000100:00100000:3.0:1788925150.921653:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788925150.921664:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470803200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788925150.921713:0:17074:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788925150.921778:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470803200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925150.921786:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788925150.921852:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a503ba5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470803200:0@lo:41:osp-pre-1-0.0 00000001:00100000:3.0:1788925150.923966:0:18572:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000020:00000080:3.0:1788925150.923977:0:18572:0:(genops.c:885:class_export_put()) final put ffff97a60401e800/6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000001:00100000:3.0:1788925150.924020:0:18572:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:3.0:1788925150.924023:0:18572:0:(genops.c:885:class_export_put()) final put ffff97a5041e1800/ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:0.0:1788925150.924176:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a60401e800/6b530a1d-251c-47c7-ab72-1e024f8a6a7c for lustre-OST0000 00000020:00000080:0.0:1788925150.924234:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e1800/ffe6e828-b125-44fe-a15e-b851ee57e41b for lustre-OST0000 00000020:00000080:0.0:1788925150.924271:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a60401f000 for lustre-OST0000 00000020:00000080:0.0:1788925150.924276:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a5041e3000 for lustre-OST0000 00010000:00010000:2.0:1788925151.787319:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925151.976920:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925151.978174:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333696 00000100:00100000:0.0:1788925151.978195:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333696 00000100:00080000:2.0:1788925151.978943:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925151.981128:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:0.0:1788925151.981159:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:15544:x1875823462333696:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788925151.983956:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:15544:x1875823462333696:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 2787us (7024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925151.983974:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1788925151.994897:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925151.994948:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462333824 00000100:00100000:1.0:1788925151.999300:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462333824 00000100:00100000:1.0:1788925151.999473:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1788925151.999491:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:15544:x1875823462333824:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788925151.999635:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:15544:x1875823462333824:12345-192.168.206.51@tcp:60:lhsmtool_posix.0 Request processed in 152us (4752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925151.999643:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00080000:1.0:1788925151.999681:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788925152.011722:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925152.011850:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334080 00000100:00100000:1.0:1788925152.011863:0:17073:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334080 00000100:00100000:1.0:1788925152.011931:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1788925152.011944:0:17073:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a607812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:15544:x1875823462334080:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788925152.012474:0:17073:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a607812850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+13:15544:x1875823462334080:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 530us (775us total) trans 8589934635 rc 0/0 00000100:00100000:1.0:1788925152.012483:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000001:00080000:3.0:1788925152.028552:0:17049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934635 is committed 00000020:00080000:3.0:1788925152.028572:0:17049:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967531 batchid updated 00000020:00080000:2.0:1788925152.029256:0:17109:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000020:00080000:2.0:1788925152.029285:0:17109:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000100:00100000:0.0:1788925152.428233:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925152.428263:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470803328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925152.428352:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925152.428433:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803328 00000100:00100000:0.0:1788925152.428451:0:18580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803328 00000100:00100000:0.0:1788925152.428527:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788925152.428546:0:18580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470803328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925152.428584:0:18580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925152.428636:0:18580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470803328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925152.428645:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788925152.428673:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925152.428735:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e36f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470803328:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788925152.810809:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925153.844896:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925154.226011:0:20447:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 23:39:12 (1788925152) 00010000:00010000:0.0:1788925154.858783:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925155.047637:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047688:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047709:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047723:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047744:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047764:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925155.047792:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334464 00000100:00100000:1.0:1788925155.047802:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334464 00000100:00100000:1.0:1788925155.047850:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334720 00000100:00100000:1.0:1788925155.047853:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334720 00000100:00100000:1.0:1788925155.047865:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334336 00000100:00100000:1.0:1788925155.047867:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334336 00000100:00100000:1.0:1788925155.047878:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334848 00000100:00100000:1.0:1788925155.047891:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334848 00000100:00100000:1.0:1788925155.047908:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1788925155.047916:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:2387:x1875823462334464:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925155.047990:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ac7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:2387:x1875823462334464:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 74us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925155.047998:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 100 00000100:00100000:1.0:1788925155.048019:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1788925155.048025:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2387:x1875823462334720:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925155.048050:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ac4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2387:x1875823462334720:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925155.048055:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 101 00000100:00100000:1.0:1788925155.048067:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:1.0:1788925155.048073:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:2387:x1875823462334336:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925155.048099:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ac6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:2387:x1875823462334336:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925155.048105:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 102 00000100:00100000:1.0:1788925155.048117:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1788925155.048124:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2387:x1875823462334848:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925155.048145:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50392b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2387:x1875823462334848:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925155.048151:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 103 00000100:00100000:1.0:1788925155.048171:0:18576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334592 00000100:00100000:1.0:1788925155.048175:0:18576:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334592 00000100:00100000:1.0:1788925155.048200:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1788925155.048216:0:18576:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5038f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+6:2387:x1875823462334592:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925155.048242:0:18576:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5038f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+6:2387:x1875823462334592:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 28us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925155.048248:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00080000:0.0:1788925155.048396:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925155.048437:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925155.048440:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788925155.048516:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334208 00000100:00100000:3.0:1788925155.048521:0:17062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334208 00000100:00100000:3.0:1788925155.048559:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1788925155.048566:0:17062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a8830b-9008-47f6-b758-a6b6e99b091b+13:2387:x1875823462334208:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1788925155.048592:0:17062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eff9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:54a8830b-9008-47f6-b758-a6b6e99b091b+13:2387:x1875823462334208:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 27us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.048598:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 176 00000100:00100000:3.0:1788925155.498904:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470803840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.498985:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499035:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470804352:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499054:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499068:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470804864:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499088:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499110:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788925155.499115:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470803712:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499139:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499159:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499178:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499193:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470804736:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499212:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499226:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470805248:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499245:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925155.499272:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803840 00000100:00100000:3.0:1788925155.499279:0:17811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803840 00000100:00100000:3.0:1788925155.499315:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804352 00000100:00100000:3.0:1788925155.499318:0:17811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804352 00000100:00100000:3.0:1788925155.499335:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788925155.499343:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470803840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499397:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470803840:12345-0@lo:400:kworker.0 Request processed in 55us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499440:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788925155.499461:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788925155.499468:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470804352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499505:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470804352:12345-0@lo:400:kworker.0 Request processed in 38us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499512:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788925155.499534:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804864 00000100:00100000:3.0:1788925155.499538:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804864 00000100:00100000:3.0:1788925155.499565:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804224 00000100:00100000:3.0:1788925155.499568:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804224 00000100:00100000:3.0:1788925155.499578:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804736 00000100:00100000:3.0:1788925155.499580:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804736 00000100:00100000:3.0:1788925155.499591:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805248 00000100:00100000:3.0:1788925155.499593:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805248 00000100:00100000:3.0:1788925155.499608:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788925155.499613:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470804864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499641:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470804864:12345-0@lo:400:kworker.0 Request processed in 27us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499646:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788925155.499659:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788925155.499664:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470804224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499686:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470804224:12345-0@lo:400:kworker.0 Request processed in 23us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499691:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788925155.499702:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925155.499707:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470804736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499729:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470804736:12345-0@lo:400:kworker.0 Request processed in 23us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499735:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925155.499746:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925155.499760:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470805248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499787:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470805248:12345-0@lo:400:kworker.0 Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499792:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925155.499811:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803712 00000100:00100000:3.0:1788925155.499815:0:17063:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803712 00000100:00100000:3.0:1788925155.499839:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788925155.499845:0:17063:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3622:x1875823470803712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499873:0:17063:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3622:x1875823470803712:12345-0@lo:400:kworker.0 Request processed in 28us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925155.499878:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788925155.499928:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470803712:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499940:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470804224:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499950:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470804736:0@lo:400:kworker.0 00010000:00080000:3.0:1788925155.499960:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62e359f80 x1875823470805248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925155.499971:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470805248:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499979:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470803840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499987:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470804352:0@lo:400:kworker.0 00000100:00100000:3.0:1788925155.499995:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470804864:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500217:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5042e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925155.500252:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500287:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470803968:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500310:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500335:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470804480:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500354:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500371:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470804992:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500390:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500448:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:0.0:1788925155.500454:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470803584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788925155.500490:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500509:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470804096:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500530:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500549:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470804608:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500566:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500582:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470805120:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500601:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925155.500629:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804992 00000100:00100000:0.0:1788925155.500634:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804992 00000100:00100000:0.0:1788925155.500661:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805120 00000100:00100000:0.0:1788925155.500664:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805120 00000100:00100000:0.0:1788925155.500680:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788925155.500686:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470804992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500724:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470804992:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.500731:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788925155.500754:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788925155.500760:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470805120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500788:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470805120:12345-0@lo:400:kworker.0 Request processed in 29us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.500793:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:0.0:1788925155.500813:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925155.500817:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925155.500826:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803968 00000100:00100000:0.0:1788925155.500829:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803968 00000100:00100000:0.0:1788925155.500852:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804480 00000100:00100000:0.0:1788925155.500854:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804480 00000100:00100000:0.0:1788925155.500864:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804096 00000100:00100000:0.0:1788925155.500866:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804096 00000100:00100000:0.0:1788925155.500876:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470804608 00000100:00100000:0.0:1788925155.500879:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470804608 00000100:00100000:0.0:1788925155.500889:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925155.500894:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470803968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500923:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470803968:12345-0@lo:400:kworker.0 Request processed in 29us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.500928:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925155.500938:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925155.500943:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470804480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.500982:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470804480:12345-0@lo:400:kworker.0 Request processed in 39us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.500988:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925155.500997:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925155.501002:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470804096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501025:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470804096:12345-0@lo:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.501037:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925155.501049:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925155.501055:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470804608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501081:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470804608:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.501086:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925155.501101:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803456 00000100:00100000:0.0:1788925155.501104:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803456 00000100:00100000:0.0:1788925155.501116:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470803584 00000100:00100000:0.0:1788925155.501118:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470803584 00000100:00100000:0.0:1788925155.501125:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925155.501130:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470803456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788925155.501150:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925155.501178:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e36f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470803456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.501184:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925155.501195:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788925155.501200:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470803584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788925155.501214:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925155.501235:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470803584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (746us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925155.501240:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788925155.501259:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925155.501261:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925155.501289:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470803584:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788925155.501298:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604899880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470804096:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501313:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470804608:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501320:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470805120:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501329:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5042e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470803456:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925155.501337:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470803968:0@lo:400:kworker.0 00000100:00100000:0.0:1788925155.501343:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470804480:0@lo:400:kworker.0 00010000:00080000:0.0:1788925155.501352:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62e358a80 x1875823470804992/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925171 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925155.501362:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470804992:0@lo:400:kworker.0 00000100:00100000:2.0:1788925155.501711:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925155.501721:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470805376:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925155.501751:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925155.501780:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805376 00000100:00100000:2.0:1788925155.501785:0:17811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805376 00000100:00100000:2.0:1788925155.501808:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925155.501814:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470805376:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788925155.501837:0:17811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788925155.501869:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470805376:12345-0@lo:41:osp-pre-0-1.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925155.501875:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925155.501900:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470805376:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925155.502219:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925155.502553:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470805504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925155.502587:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925155.502688:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805504 00000100:00100000:2.0:1788925155.502693:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805504 00000100:00100000:2.0:1788925155.502759:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788925155.502766:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470805504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925155.502780:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17125056 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925155.502818:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470805504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925155.502823:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925155.502879:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470805504:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788925155.755329:0:17824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788925155.882590:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925156.013692:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925156.013713:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470805632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925156.013779:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925156.015966:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805632 00000100:00100000:0.0:1788925156.015978:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805632 00000100:00100000:0.0:1788925156.016070:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788925156.016081:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470805632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925156.016115:0:17075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925156.016193:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470805632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925156.016199:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788925156.016270:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470805632:0@lo:41:osp-pre-1-0.0 00000040:00080000:1.0:1788925156.778615:0:17103:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788925156.778624:0:17103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788925156.778644:0:17103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788925156.778650:0:17103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:0.0:1788925156.906922:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925157.548428:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925157.548451:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470805760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925157.548519:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925157.548662:0:18580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805760 00000100:00100000:2.0:1788925157.548681:0:18580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805760 00000100:00100000:2.0:1788925157.548737:0:18580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788925157.548747:0:18580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470805760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925157.548774:0:18580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925157.548817:0:18580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470805760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925157.548824:0:18580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788925157.548872:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470805760:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788925157.549569:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788925157.930580:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925158.955265:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925159.253376:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925159.253476:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925159.253502:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925159.253549:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462334976 00000100:00100000:2.0:1788925159.253560:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462334976 00000100:00100000:3.0:1788925159.253609:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462335232 00000100:00100000:2.0:1788925159.253618:0:17056:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462335104 00000100:00100000:3.0:1788925159.253622:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462335232 00000100:00100000:2.0:1788925159.253625:0:17056:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462335104 00000100:00100000:3.0:1788925159.253680:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1788925159.253691:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+15:2387:x1875823462334976:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925159.253710:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925159.253732:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a62d985c00/0x45e32cfaf7423644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f346f expref: 15 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925159.253751:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925159.253827:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+14:2387:x1875823462334976:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 137us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925159.253835:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:3.0:1788925159.253864:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:3.0:1788925159.253872:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+13:2387:x1875823462335232:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925159.253881:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925159.253892:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34c400/0x45e32cfaf74236d0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3556 expref: 13 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925159.253905:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925159.253934:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+12:2387:x1875823462335232:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 58us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925159.253940:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:1.0:1788925159.253963:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925159.254273:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1788925159.254283:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54a8830b-9008-47f6-b758-a6b6e99b091b+11:2387:x1875823462335104:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925159.254298:0:17056:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925159.254316:0:17056:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a62d985e00/0x45e32cfaf742364b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f34a0 expref: 11 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.254332:0:17056:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925159.254727:0:18578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462335488 00000100:00100000:0.0:1788925159.254734:0:18578:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462335488 00000100:00100000:0.0:1788925159.254777:0:18578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1788925159.254787:0:18578:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+6:2386:x1875823462335488:12345-192.168.206.51@tcp:9:umount.0 00000100:00080000:3.0:1788925159.254803:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925159.254855:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:54a8830b-9008-47f6-b758-a6b6e99b091b+10:2387:x1875823462335104:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 571us (1349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925159.254870:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000020:00000080:0.0:1788925159.273174:0:18578:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742366e 00000020:00010000:0.0:1788925159.273195:0:18578:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97a501f32800: total 0 00000100:00080000:0.0:1788925159.273202:0:18578:0:(import.c:65:import_set_state_nolock()) ffff97a501f30800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788925159.273267:0:18578:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788925159.273458:0:18578:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+4:2386:x1875823462335488:12345-192.168.206.51@tcp:9:umount.0 Request processed in 18668us (19494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925159.273470:0:18578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000020:00010000:2.0:1788925159.273821:0:17058:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97a501f32800: total 0 00010000:00010000:2.0:1788925159.273839:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.273874:0:17058:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a501f32800, canceled 0 locks, left on hash table 1. 00002000:00010000:2.0:1788925159.273915:0:17058:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788925159.273919:0:17058:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788925159.273942:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006965f607/0x45e32cfaf74239d9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3636 expref: 3 pid: 18952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.273966:0:17058:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a501f32800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788925159.273977:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.273979:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.273981:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925159.284173:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925159.284243:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462336384 00000100:00100000:0.0:1788925159.284252:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462336384 00000100:00100000:0.0:1788925159.284332:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 76 00000100:00100000:0.0:1788925159.284343:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+12:2386:x1875823462336384:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:0.0:1788925159.284375:0:17069:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423659 00000020:00010000:0.0:1788925159.284391:0:17069:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97a50426d800: total 0 00000100:00080000:0.0:1788925159.284396:0:17069:0:(import.c:65:import_set_state_nolock()) ffff97a604180000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788925159.284459:0:17069:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934635 00000100:00100000:0.0:1788925159.284637:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ffe6e828-b125-44fe-a15e-b851ee57e41b+11:2386:x1875823462336384:12345-192.168.206.51@tcp:39:umount.0 Request processed in 296us (473us total) trans 8589934636 rc 0/0 00000100:00100000:0.0:1788925159.284645:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 76 00000020:00010000:2.0:1788925159.285023:0:17057:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97a50426d800: total 0 00010000:00010000:2.0:1788925159.285068:0:17057:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a50426d800, canceled 0 locks, left on hash table 7. 00010000:00010000:2.0:1788925159.285097:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a610ff2000) 00010000:00010000:2.0:1788925159.285101:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788925159.285109:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74239ee lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f363d expref: 10 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285124:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a50286df00) 00010000:00010000:2.0:1788925159.285126:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925159.285130:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a618378200/0x45e32cfaf7423724 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f355d expref: 9 pid: 17069 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285146:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff97a610ff2f00) 00010000:00010000:2.0:1788925159.285148:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788925159.285152:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a501f07000/0x45e32cfaf7423804 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f359c expref: 8 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285166:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff97a503701a00) 00010000:00010000:2.0:1788925159.285181:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788925159.285186:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf7423985 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3613 expref: 7 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285202:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a503701200) 00010000:00010000:2.0:1788925159.285204:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925159.285207:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7423740 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3564 expref: 6 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285220:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff97a610ff2000) 00010000:00010000:2.0:1788925159.285222:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788925159.285225:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a618378a00/0x45e32cfaf742392a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f35fe expref: 5 pid: 17071 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285237:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a503701300) 00010000:00010000:2.0:1788925159.285239:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925159.285242:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742377f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3572 expref: 4 pid: 20211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925159.285250:0:17057:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a50426d800, canceled 7 locks, left on hash table 0. 00010000:00010000:2.0:1788925159.285262:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.285264:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.285265:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788925159.285941:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925159.306152:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925159.309833:0:17071:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462336512 00000100:00100000:0.0:1788925159.309847:0:17071:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462336512 00000100:00100000:1.0:1788925159.313124:0:17071:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 77 00000100:00100000:1.0:1788925159.313140:0:17071:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+5:2386:x1875823462336512:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:1.0:1788925159.313173:0:17071:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423660 00000100:00080000:1.0:1788925159.313192:0:17071:0:(import.c:65:import_set_state_nolock()) ffff97a50258a000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788925159.313228:0:17071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1788925159.313661:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788925159.314068:0:17071:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ffe6e828-b125-44fe-a15e-b851ee57e41b+3:2386:x1875823462336512:12345-192.168.206.51@tcp:39:umount.0 Request processed in 930us (7921us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788925159.314077:0:17071:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 77 00010000:00010000:2.0:1788925159.314183:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925159.978665:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925160.165795:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925160.165903:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925160.165942:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925160.165976:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462336640 00000100:00100000:2.0:1788925160.165987:0:17064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462336640 00000100:00100000:2.0:1788925160.166048:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:2.0:1788925160.166059:0:17064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a8830b-9008-47f6-b758-a6b6e99b091b+10:2390:x1875823462336640:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925160.166214:0:17064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a8830b-9008-47f6-b758-a6b6e99b091b+10:2390:x1875823462336640:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 157us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.166223:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 178 00000100:00100000:0.0:1788925160.179631:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462336768 00000100:00100000:0.0:1788925160.179655:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462336768 00000100:00100000:0.0:1788925160.179812:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462336896 00000100:00100000:0.0:1788925160.179817:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462336896 00000100:00100000:2.0:1788925160.179905:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00100000:2.0:1788925160.179921:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2390:x1875823462336768:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925160.180016:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2390:x1875823462336768:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 100us (14694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.180023:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 110 00000100:00080000:3.0:1788925160.185777:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788925160.185788:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788925160.187008:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1788925160.187024:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2390:x1875823462336896:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925160.188176:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2390:x1875823462336896:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 1152us (22226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925160.188202:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 111 00000100:00100000:0.0:1788925160.619156:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470805888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788925160.619218:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925160.619422:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470806016:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925160.619451:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.619601:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806016 00000100:00100000:1.0:1788925160.619609:0:17074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806016 00000100:00100000:1.0:1788925160.619651:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788925160.619658:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470806016:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788925160.619690:0:17074:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788925160.619733:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470806016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925160.619739:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788925160.619819:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470806016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925160.620072:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925160.620080:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470806144:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788925160.620106:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620265:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470806400:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620289:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620308:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470806912:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620332:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620354:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470807424:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620379:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620429:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788925160.620435:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470806272:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620461:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620480:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470806784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620663:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620682:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1875823470807296:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620702:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925160.620726:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806912 00000100:00100000:1.0:1788925160.620732:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806912 00000100:00100000:1.0:1788925160.620774:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807424 00000100:00100000:1.0:1788925160.620777:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807424 00000100:00100000:1.0:1788925160.620794:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806784 00000100:00100000:1.0:1788925160.620796:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806784 00000100:00100000:1.0:1788925160.620804:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807296 00000100:00100000:1.0:1788925160.620806:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807296 00000100:00100000:1.0:1788925160.620819:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788925160.620825:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470806912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620879:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470806912:12345-0@lo:400:kworker.0 Request processed in 54us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925160.620886:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788925160.620900:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788925160.620906:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470807424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620933:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470807424:12345-0@lo:400:kworker.0 Request processed in 28us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925160.620939:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788925160.620950:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788925160.620957:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470806784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.620999:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470806784:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925160.621005:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788925160.621018:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788925160.621024:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875823470807296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.621050:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875823470807296:12345-0@lo:400:kworker.0 Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925160.621055:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788925160.621087:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470806784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.621103:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3622:1875823470807296:0@lo:400:kworker.0 00000100:00100000:1.0:1788925160.621109:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470806912:0@lo:400:kworker.0 00010000:00080000:1.0:1788925160.621118:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5039b0000 x1875823470807424/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925160.621126:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470807424:0@lo:400:kworker.0 00000100:00100000:0.0:1788925160.621264:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806400 00000100:00100000:0.0:1788925160.621267:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806400 00000100:00100000:0.0:1788925160.621301:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788925160.621308:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470806400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925160.621348:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470806400:12345-0@lo:400:kworker.0 Request processed in 41us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925160.621354:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788925160.621378:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470806400:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.621481:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470806656:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.621524:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925160.621554:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470807168:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.621574:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925160.621592:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788925160.621598:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470806528:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.621614:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925160.621629:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470807040:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.621644:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925160.621655:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470807552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925160.621672:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925160.621693:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470805888 00000100:00100000:2.0:1788925160.621697:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470805888 00000100:00100000:2.0:1788925160.621718:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806144 00000100:00100000:2.0:1788925160.621720:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806144 00000100:00100000:2.0:1788925160.621731:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807552 00000100:00100000:2.0:1788925160.621733:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807552 00000100:00100000:2.0:1788925160.621757:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788925160.621762:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470805888:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925160.621784:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925160.621820:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470805888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (2602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.621827:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788925160.621839:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925160.621845:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470806144:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788925160.621872:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925160.621899:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470806144:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (1792us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.621904:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925160.621914:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925160.621919:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470807552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925160.621938:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925160.621963:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470807552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 44us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.621968:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925160.621983:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806656 00000100:00100000:2.0:1788925160.621986:0:18577:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806656 00000100:00100000:2.0:1788925160.622003:0:18577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806528 00000100:00100000:2.0:1788925160.622005:0:18577:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806528 00000100:00100000:2.0:1788925160.622018:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925160.622022:0:18577:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470806656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622044:0:18577:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470806656:12345-0@lo:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.622059:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788925160.622068:0:18577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925160.622072:0:18577:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470806528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622093:0:18577:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470806528:12345-0@lo:400:kworker.0 Request processed in 21us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.622097:0:18577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925160.622121:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470806528:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622133:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470807552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925160.622139:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470806656:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622157:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807168 00000100:00100000:2.0:1788925160.622160:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807168 00000100:00100000:2.0:1788925160.622177:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807040 00000100:00100000:2.0:1788925160.622179:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807040 00000100:00100000:2.0:1788925160.622189:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788925160.622193:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470807168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622219:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470807168:12345-0@lo:400:kworker.0 Request processed in 25us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.622223:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788925160.622232:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788925160.622238:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470807040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622256:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470807040:12345-0@lo:400:kworker.0 Request processed in 20us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925160.622261:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788925160.622278:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470807040:0@lo:400:kworker.0 00010000:00080000:2.0:1788925160.622293:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5039b3800 x1875823470807168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925160.622303:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470807168:0@lo:400:kworker.0 00000100:00100000:2.0:1788925160.622335:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470805888:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788925160.622619:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470806272 00000100:00100000:3.0:1788925160.622624:0:17062:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470806272 00000100:00100000:3.0:1788925160.622657:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788925160.622663:0:17062:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3622:x1875823470806272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925160.622705:0:17062:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3622:x1875823470806272:12345-0@lo:400:kworker.0 Request processed in 42us (2243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925160.622710:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788925160.622751:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470806144:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788925160.622767:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925160.622771:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925160.622773:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788925160.622775:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788925160.622832:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470806272:0@lo:400:kworker.0 00010000:00010000:2.0:1788925161.003153:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925161.131128:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925161.131152:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470807680:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788925161.131219:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925161.131361:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807680 00000100:00100000:1.0:1788925161.131369:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807680 00000100:00100000:1.0:1788925161.131461:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788925161.131474:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470807680:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788925161.131521:0:17075:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788925161.131582:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470807680:12345-0@lo:41:osp-pre-1-0.0 Request processed in 112us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925161.131589:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788925161.131752:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470807680:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925161.482729:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925161.482770:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925161.482825:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925161.482950:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337024 00000100:00100000:3.0:1788925161.482959:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337024 00000100:00100000:3.0:1788925161.483004:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337280 00000100:00100000:3.0:1788925161.483007:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337280 00000100:00100000:3.0:1788925161.483019:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337152 00000100:00100000:3.0:1788925161.483021:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337152 00000100:00100000:3.0:1788925161.483036:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1788925161.483044:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+12:2390:x1875823462337024:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925161.483059:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925161.483078:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f07a00/0x45e32cfaf7423683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f34df expref: 12 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925161.483093:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925161.483160:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+11:2390:x1875823462337024:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 116us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925161.483168:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:3.0:1788925161.483185:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1788925161.483191:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+10:2390:x1875823462337280:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925161.483199:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925161.483208:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06e00/0x45e32cfaf74236c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f354f expref: 10 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925161.483229:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925161.483249:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+9:2390:x1875823462337280:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 58us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925161.483256:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1788925161.483269:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:3.0:1788925161.483275:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+8:2390:x1875823462337152:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925161.483282:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925161.483290:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c437e00/0x45e32cfaf742368a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3510 expref: 8 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925161.483298:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925161.483314:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:54a8830b-9008-47f6-b758-a6b6e99b091b+7:2390:x1875823462337152:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 39us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925161.483320:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:2.0:1788925161.495083:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925161.500761:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337536 00000100:00100000:0.0:1788925161.500776:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337536 00000100:00100000:0.0:1788925161.500847:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 78 00000100:00100000:0.0:1788925161.500865:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+6:2386:x1875823462337536:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:0.0:1788925161.500920:0:20211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423698 00000020:00010000:0.0:1788925161.500928:0:20211:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97a60773b000: total 0 00000100:00080000:0.0:1788925161.500932:0:20211:0:(import.c:65:import_set_state_nolock()) ffff97a60773f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788925161.500967:0:20211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934636 00000100:00100000:0.0:1788925161.501100:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2386:x1875823462337536:12345-192.168.206.51@tcp:39:umount.0 Request processed in 244us (6026us total) trans 8589934637 rc 0/0 00000100:00100000:0.0:1788925161.501108:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 78 00000020:00010000:3.0:1788925161.501638:0:17057:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97a60773b000: total 0 00010000:00010000:3.0:1788925161.501643:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925161.501697:0:17057:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a60773b000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788925161.501727:0:17057:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a503701300) 00010000:00010000:3.0:1788925161.501738:0:17057:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925161.501748:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a501f06c00/0x45e32cfaf742378d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3579 expref: 4 pid: 17070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925161.501771:0:17057:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a60773b000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788925161.501782:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925161.501784:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925161.501786:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925161.513868:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925161.514194:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337664 00000100:00100000:2.0:1788925161.514208:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337664 00000100:00100000:2.0:1788925161.514289:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:2.0:1788925161.514302:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+5:2386:x1875823462337664:12345-192.168.206.51@tcp:39:umount.0 00000020:00000080:2.0:1788925161.514369:0:17070:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742369f 00000100:00080000:2.0:1788925161.514382:0:17070:0:(import.c:65:import_set_state_nolock()) ffff97a501f33000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788925161.514477:0:17070:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00010000:00010000:3.0:1788925161.515020:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925161.515067:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6b530a1d-251c-47c7-ab72-1e024f8a6a7c+3:2386:x1875823462337664:12345-192.168.206.51@tcp:39:umount.0 Request processed in 766us (1213us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788925161.515078:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 79 00000100:00100000:1.0:1788925161.575564:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925161.575823:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462337920 00000100:00100000:2.0:1788925161.575836:0:17064:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462337920 00000100:00100000:2.0:1788925161.575910:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 180 00000100:00100000:2.0:1788925161.575921:0:17064:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62effac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a8830b-9008-47f6-b758-a6b6e99b091b+7:2386:x1875823462337920:12345-192.168.206.51@tcp:251:umount.0 00000020:00000080:2.0:1788925161.575975:0:17064:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423636 00000020:00010000:2.0:1788925161.575984:0:17064:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97a50426a000: total 0 00000100:00080000:2.0:1788925161.575989:0:17064:0:(import.c:65:import_set_state_nolock()) ffff97a504268800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788925161.576080:0:17064:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62effac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:54a8830b-9008-47f6-b758-a6b6e99b091b+3:2386:x1875823462337920:12345-192.168.206.51@tcp:251:umount.0 Request processed in 160us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925161.576120:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 180 00000020:00010000:0.0:1788925161.576356:0:17057:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97a50426a000: total 0 00010000:00010000:0.0:1788925161.576489:0:17057:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a50426a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788925161.576532:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c436c00/0x45e32cfaf742363d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3468 expref: 2 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925161.576548:0:17057:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a50426a000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788925161.576559:0:17057:0:(genops.c:885:class_export_put()) final put ffff97a50426a000/54a8830b-9008-47f6-b758-a6b6e99b091b 00010000:00010000:0.0:1788925161.576569:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925161.576572:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925161.576573:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788925161.576811:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50426a000/54a8830b-9008-47f6-b758-a6b6e99b091b for MGS 00000020:00000080:2.0:1788925161.576860:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a504268800 for MGS 00010000:00010000:0.0:1788925162.026981:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925162.668303:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470807808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925162.668371:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925162.670242:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807808 00000100:00100000:2.0:1788925162.670253:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807808 00000100:00100000:2.0:1788925162.670309:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925162.670318:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470807808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925162.670347:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925162.670455:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470807808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 138us (2082us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925162.670464:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925162.670709:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470807808:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788925162.670842:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788925163.050700:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788925163.317864:0:20642:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788925163.336980:0:20642:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788925163.337033:0:20642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337046:0:20642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337053:0:20642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337070:0:20642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337085:0:20642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925163.337090:0:20642:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00010000:00010000:0.0:1788925163.337115:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925163.337120:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337126:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a618378400 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925163.337130:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337139:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925163.337146:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925163.337152:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788925163.337154:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788925163.337157:0:17058:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788925163.337188:0:17058:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337195:0:17058:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925163.337228:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337234:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a618378400/0x45e32cfaf74231f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423200 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.337252:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925163.337253:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925163.337255:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925163.337268:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925163.337272:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925163.337278:0:20642:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788925163.337290:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a608b36000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788925163.337399:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470807936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925163.337485:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925163.337543:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470808064:0@lo:39:umount.0 00000100:00100000:2.0:1788925163.337569:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925163.337600:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808064 00000100:00100000:2.0:1788925163.337607:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808064 00000100:00100000:2.0:1788925163.337646:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788925163.337655:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875823470808064:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788925163.337680:0:20211:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742322a 00000100:00080000:2.0:1788925163.337688:0:20211:0:(import.c:65:import_set_state_nolock()) ffff97a607830000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788925163.337741:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3620:x1875823470808064:12345-0@lo:39:umount.0 Request processed in 87us (170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925163.337749:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000020:00000080:2.0:1788925163.337757:0:20211:0:(genops.c:885:class_export_put()) final put ffff97a504135000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1788925163.337788:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788925163.337811:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a608b36000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788925163.337819:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470808064:0@lo:39:umount.0 00000020:00000080:2.0:1788925163.337839:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a504135000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788925163.337881:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a607830000 for lustre-MDT0000 00000100:00100000:0.0:1788925163.339395:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470807936 00000100:00100000:0.0:1788925163.339425:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470807936 00000100:00100000:0.0:1788925163.339479:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925163.339488:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6358f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3622:x1875823470807936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925163.339501:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925163.339518:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a618379400/0x45e32cfaf7423200 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74231f9 expref: 24 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.339537:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925163.339586:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6358f9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+23:3622:x1875823470807936:12345-0@lo:103:ldlm_bl.0 Request processed in 100us (2102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925163.339594:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788925163.339643:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925163.339647:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925163.339652:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788925163.340781:0:20642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.340797:0:20642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.340815:0:20642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.340822:0:20642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925163.340949:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470807936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925163.340993:0:20642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925163.341002:0:20642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.341008:0:20642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.341013:0:20642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.341019:0:20642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341700:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925163.341710:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341718:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925163.341723:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341739:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925163.341745:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925163.341750:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788925163.341752:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788925163.341780:0:17058:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341785:0:17058:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925163.341814:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341821:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a62d984800/0x45e32cfaf742314a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423151 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341830:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925163.341833:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341838:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a618379e00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925163.341841:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341847:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925163.341852:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925163.341862:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788925163.341864:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1788925163.341875:0:17058:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341879:0:17058:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925163.341885:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925163.341891:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925163.341892:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925163.341894:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925163.341937:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470808192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925163.341993:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.342040:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925163.342046:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470808320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925163.342068:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.342097:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808192 00000100:00100000:3.0:1788925163.342102:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808192 00000100:00100000:3.0:1788925163.342138:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808320 00000100:00100000:3.0:1788925163.342141:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808320 00000100:00100000:3.0:1788925163.342158:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925163.342166:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+24:3623:x1875823470808192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925163.342177:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925163.342191:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a618379000/0x45e32cfaf7423151 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742314a expref: 24 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925163.342207:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925163.342244:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+23:3623:x1875823470808192:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.342251:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788925163.342269:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925163.342275:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+22:3623:x1875823470808320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925163.342282:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925163.342290:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c436a00/0x45e32cfaf7423564 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742355d expref: 22 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925163.342298:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925163.342318:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+21:3623:x1875823470808320:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.342323:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925163.342350:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470808320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925163.342359:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470808192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925163.342692:0:20642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788925163.342698:0:20642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a618379e00/0x45e32cfaf742355d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423564 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925163.342711:0:20642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788925163.342719:0:20642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.342726:0:20642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.342740:0:20642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.342745:0:20642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.342776:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925163.342783:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.342790:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60a34de00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925163.342793:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.342801:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925163.342808:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925163.342813:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788925163.342815:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:2.0:1788925163.342832:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.342839:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788925163.342878:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925113dd-c433-4b1b-8c21-0406d9c92f6b:3621:1875823470808448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925163.342911:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925163.342963:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.342982:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.342983:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.342985:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925163.343025:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808448 00000100:00100000:3.0:1788925163.343030:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808448 00000100:00100000:3.0:1788925163.343067:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925163.343075:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+21:3621:x1875823470808448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925163.343082:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925163.343091:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a62d985000/0x45e32cfaf7423708 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf7423701 expref: 21 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925163.343100:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925163.343169:0:20642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788925163.343174:0:20642:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60a34de00/0x45e32cfaf7423701 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423708 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925163.343184:0:20642:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788925163.343191:0:20642:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.343198:0:20642:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.343203:0:20642:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.343209:0:20642:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925163.343218:0:20642:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925163.343221:0:20642:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788925163.343224:0:20642:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788925163.343254:0:20642:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788925163.343258:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788925163.343261:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925163.343273:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788925163.343277:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97a5041e4000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925163.343283:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97a62e201000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925163.343288:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97a604ed3800 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925163.343292:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff97a634ebd800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925163.343299:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff97a60773b000 6b530a1d-251c-47c7-ab72-1e024f8a6a7c 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788925163.343304:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff97a50426d800 ffe6e828-b125-44fe-a15e-b851ee57e41b 192.168.206.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934635 stale:0 00000020:00080000:0.0:1788925163.343309:0:20642:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff97a5038b4d40) has exports, disconnecting them 00000020:00080000:0.0:1788925163.343313:0:20642:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a5041e4000), last request at 1788925160 00000020:00000080:0.0:1788925163.343321:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742352c 00000100:00080000:0.0:1788925163.343338:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a5041e1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788925163.343379:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a5041e4000): rc 0 00000020:00000080:0.0:1788925163.343393:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a5041e4000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788925163.343421:0:20642:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a62e201000), last request at 1788925160 00000020:00000080:0.0:1788925163.343425:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74233ce 00000100:00080000:0.0:1788925163.343429:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a62e206800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788925163.343435:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a62e201000): rc 0 00000020:00000080:0.0:1788925163.343437:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a62e201000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788925163.343440:0:20642:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a604ed3800), last request at 1788925073 00000020:00000080:0.0:1788925163.343442:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423318 00000100:00080000:0.0:1788925163.343445:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a604ed2800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788925163.343449:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a604ed3800): rc 0 00000020:00000080:0.0:1788925163.343451:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a604ed3800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788925163.343454:0:20642:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff97a634ebd800), last request at 1788925073 00000020:00000080:0.0:1788925163.343456:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232af 00000100:00080000:0.0:1788925163.343459:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a604c2b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788925163.343472:0:20642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000020:00080000:0.0:1788925163.343530:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a634ebd800): rc 0 00000004:00000080:0.0:1788925163.343535:0:20642:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb6454556fae0 00000100:00080000:0.0:1788925163.343549:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788925163.343552:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925163.344304:0:20642:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788925163.344324:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a503a1e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788925163.344443:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925163.344450:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.344459:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925163.344463:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.344471:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925163.344478:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925163.344484:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788925163.344486:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788925163.344489:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788925163.344512:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.344519:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788925163.344579:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470808704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925163.344625:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.344843:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+20:3621:x1875823470808448:12345-0@lo:103:ldlm_bl.0 Request processed in 1767us (1929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.344854:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925163.344887:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808704 00000100:00100000:3.0:1788925163.344893:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808704 00000100:00100000:3.0:1788925163.344926:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925163.344934:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+20:3622:x1875823470808704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925163.344944:0:17055:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925163.344955:0:17055:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34c200/0x45e32cfaf7423143 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742313c expref: 20 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925163.344969:0:17055:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925163.345001:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:925113dd-c433-4b1b-8c21-0406d9c92f6b+19:3622:x1875823470808704:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.345007:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925163.345040:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470808704:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925163.345075:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808576:0@lo:39:umount.0 00000100:00100000:3.0:1788925163.345103:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:3.0:1788925163.345133:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e4000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788925163.345173:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62e201000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788925163.345192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604ed3800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788925163.345210:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a5041e1000 for lustre-MDT0000 00000020:00000080:3.0:1788925163.345215:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a62e206800 for lustre-MDT0000 00000020:00000080:3.0:1788925163.345218:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604ed2800 for lustre-MDT0000 00010000:00010000:3.0:1788925163.345226:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.345714:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.345725:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a62d985800/0x45e32cfaf742313c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423143 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925163.345749:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.345750:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.345752:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925163.345873:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788925163.345877:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1788925163.345896:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788925163.345958:0:20642:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788925163.345974:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a607831000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788925163.345993:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788925163.345995:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1788925163.346004:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788925163.346064:0:20642:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788925163.346072:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a61a49c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788925163.346112:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff97a5038b4d40) has no exports 00000100:00100000:3.0:1788925163.346159:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808832:0@lo:9:umount.0 00000100:00100000:3.0:1788925163.346196:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.346223:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808960:0@lo:9:umount.0 00000100:00100000:3.0:1788925163.346242:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925163.346282:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808832 00000100:00100000:3.0:1788925163.346288:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808832 00000100:00100000:3.0:1788925163.346317:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808960 00000100:00100000:3.0:1788925163.346320:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808960 00000100:00100000:3.0:1788925163.346342:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788925163.346348:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875823470808832:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788925163.346367:0:18952:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742340d 00000100:00080000:3.0:1788925163.346375:0:18952:0:(import.c:65:import_set_state_nolock()) ffff97a501f16000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925163.346471:0:18952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788925163.346580:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3620:x1875823470808832:12345-0@lo:9:umount.0 Request processed in 232us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.346587:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788925163.346600:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925163.346606:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1875823470808960:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788925163.346616:0:18952:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742356b 00000100:00080000:3.0:1788925163.346621:0:18952:0:(import.c:65:import_set_state_nolock()) ffff97a50383e800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788925163.346638:0:18952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:3.0:1788925163.346696:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3620:x1875823470808960:12345-0@lo:9:umount.0 Request processed in 91us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925163.346702:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788925163.346720:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925163.346744:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a607831000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788925163.346748:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788925163.346749:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788925163.346752:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808832:0@lo:9:umount.0 00000100:00080000:3.0:1788925163.346759:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a61a49c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788925163.346765:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788925163.346767:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788925163.346769:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808960:0@lo:9:umount.0 00010000:00010000:3.0:1788925163.346795:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925163.347085:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925163.349456:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a602c90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:925113dd-c433-4b1b-8c21-0406d9c92f6b:3621:1875823470808448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925163.349495:0:17074:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470808576 00000100:00100000:1.0:1788925163.349502:0:17074:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470808576 00000100:00100000:1.0:1788925163.349550:0:17074:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788925163.349559:0:17074:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1875823470808576:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788925163.349589:0:17074:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423342 00000100:00080000:1.0:1788925163.349598:0:17074:0:(import.c:65:import_set_state_nolock()) ffff97a50258d000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788925163.349622:0:17074:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788925163.349753:0:17074:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3620:x1875823470808576:12345-0@lo:39:umount.0 Request processed in 195us (4648us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788925163.349761:0:17074:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788925163.349794:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a503a1e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788925163.349800:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470808576:0@lo:39:umount.0 00010000:00010000:0.0:1788925163.349872:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788925163.358833:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff97a5038b4d40) has no exports 00000020:00000080:0.0:1788925163.411512:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423197 00000020:00000080:0.0:1788925163.411528:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a6048b3000/lustre-QMT0000_UUID 00000020:01000000:0.0:1788925163.411598:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788925163.411740:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925163.411749:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788925163.411754:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff97a50359cd40) has no exports 00000020:00000080:1.0:1788925163.412067:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423190 00000020:00000080:1.0:1788925163.412074:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a63cf5b800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788925163.412276:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a6048b3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788925163.412689:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63cf5b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788925163.412758:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925163.412767:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788925163.412771:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a63cf58000/lustre-QMT0000_UUID 00000020:00000080:1.0:1788925163.412773:0:20642:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63cf58000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1788925163.412781:0:20642:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1788925164.074825:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788925164.724216:0:17803:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788925164.724244:0:17803:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788925164.724249:0:17803:0:(genops.c:885:class_export_put()) final put ffff97a608b34800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788925164.724265:0:17803:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000001:00080000:1.0:1788925164.724272:0:17803:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788925164.724275:0:17803:0:(genops.c:885:class_export_put()) final put ffff97a501f37800/6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000001:00100000:1.0:1788925164.724285:0:17803:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of ffe6e828-b125-44fe-a15e-b851ee57e41b 00000001:00080000:1.0:1788925164.724293:0:17803:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788925164.724297:0:17803:0:(genops.c:885:class_export_put()) final put ffff97a604181000/ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:3.0:1788925164.724947:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a608b34800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1788925164.725036:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a501f37800/6b530a1d-251c-47c7-ab72-1e024f8a6a7c for lustre-MDT0001 00000020:00000080:3.0:1788925164.725069:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604181000/ffe6e828-b125-44fe-a15e-b851ee57e41b for lustre-MDT0001 00000020:00000080:3.0:1788925164.725097:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50258d000 for lustre-MDT0001 00000001:00100000:1.0:1788925164.725270:0:17049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788925164.725276:0:17049:0:(genops.c:885:class_export_put()) final put ffff97a634ebd800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788925164.725298:0:17049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000001:00080000:1.0:1788925164.725306:0:17049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934637 is committed 00000020:00000080:1.0:1788925164.725310:0:17049:0:(genops.c:885:class_export_put()) final put ffff97a60773b000/6b530a1d-251c-47c7-ab72-1e024f8a6a7c 00000001:00100000:1.0:1788925164.725316:0:17049:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ffe6e828-b125-44fe-a15e-b851ee57e41b 00000001:00080000:1.0:1788925164.725319:0:17049:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934636 is committed 00000020:00000080:1.0:1788925164.725321:0:17049:0:(genops.c:885:class_export_put()) final put ffff97a50426d800/ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:3.0:1788925164.725367:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a501f33000 for lustre-MDT0001 00000020:00000080:3.0:1788925164.725371:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50258a000 for lustre-MDT0001 00000020:00000080:3.0:1788925164.725385:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634ebd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788925164.725773:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a60773b000/6b530a1d-251c-47c7-ab72-1e024f8a6a7c for lustre-MDT0000 00000020:00000080:3.0:1788925164.725817:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50426d800/ffe6e828-b125-44fe-a15e-b851ee57e41b for lustre-MDT0000 00000020:00000080:3.0:1788925164.725848:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604c2b800 for lustre-MDT0000 00000020:00000080:3.0:1788925164.725853:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a60773f800 for lustre-MDT0000 00000020:00000080:3.0:1788925164.725857:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604180000 for lustre-MDT0000 00000001:00100000:2.0:1788925164.726731:0:19392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788925164.726739:0:19392:0:(genops.c:885:class_export_put()) final put ffff97a50383a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788925164.726764:0:19392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:2.0:1788925164.726767:0:19392:0:(genops.c:885:class_export_put()) final put ffff97a501f32800/ffe6e828-b125-44fe-a15e-b851ee57e41b 00000020:00000080:0.0:1788925164.726818:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50383a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788925164.726882:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a501f32800/ffe6e828-b125-44fe-a15e-b851ee57e41b for lustre-OST0001 00000020:00000080:0.0:1788925164.726906:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50383e800 for lustre-OST0001 00000020:00000080:0.0:1788925164.726929:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a501f30800 for lustre-OST0001 00010000:00010000:0.0:1788925165.098680:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788925165.418696:0:20642:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a603e96a80 - data ffff97a62a434288/ffff97a5035be400 00000020:01000000:0.0:1788925165.418923:0:20642:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a5039498a0 - data ffff97a62a555af8/ffff97a63c57d000 00000001:00000004:0.0:1788925165.427851:0:20642:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934637 00000100:00080000:2.0:1788925165.505417:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788925165.505426:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788925165.505441:0:20642:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff97a62e350a80 x1875823470808576/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788925173 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925165.505468:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1788925165.507683:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788925165.507690:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:2.0:1788925165.507712:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925165.507714:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788925165.508439:0:17093:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788925165.508445:0:17093:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788925165.508458:0:17093:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788925165.509011:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788925165.509016:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:2.0:1788925165.509036:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925165.509038:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788925165.509801:0:17095:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788925165.509805:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788925165.509816:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788925165.514106:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742315f 00000020:00000080:3.0:1788925165.514123:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a503baf000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788925165.515142:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503baf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788925165.521180:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423174 00000020:00000080:2.0:1788925165.521194:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a63f745800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788925165.521215:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788925165.521220:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925165.521228:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788925165.521232:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff97a5038b0000) has no exports 00000004:01000000:2.0:1788925165.521464:0:20642:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788925165.521474:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231d6 00000020:00000080:2.0:1788925165.521478:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a504130000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788925165.521482:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788925165.521486:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925165.521490:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788925165.521493:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff97a5037419c0) has no exports 00000020:00000080:2.0:1788925165.521500:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231cf 00000020:00000080:2.0:1788925165.521503:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a604c6b800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788925165.521662:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63f745800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1788925165.521675:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a504130000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788925165.521683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604c6b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788925165.522007:0:20642:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788925165.522012:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788925165.522016:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788925165.522022:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925165.522024:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788925165.522106:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788925165.522113:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788925165.522118:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231c1 00000020:00000080:2.0:1788925165.522124:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a634ebe000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788925165.523902:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a61a49c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788925165.523917:0:37:0:(genops.c:885:class_export_put()) final put ffff97a634eba000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788925165.523919:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634eba000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788925165.523927:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788925165.526338:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788925165.526354:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925165.526365:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788925165.526382:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff97a635998000) has no exports 00000020:00000080:2.0:1788925165.526392:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231ba 00000020:00000080:2.0:1788925165.526413:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a607836800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1788925165.526930:0:20642:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788925165.526936:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788925165.526940:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788925165.526946:0:20642:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925165.526948:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788925165.526980:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788925165.526987:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788925165.527001:0:20642:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788925165.527017:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231ac 00000020:00000080:2.0:1788925165.527023:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a603ef7800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788925165.527027:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788925165.527030:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925165.527034:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00000080:0.0:1788925165.527185:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634ebe000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788925165.527194:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a607836800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788925165.527199:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a607831000 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788925165.527205:0:37:0:(genops.c:885:class_export_put()) final put ffff97a603ef4000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788925165.527207:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a603ef4000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788925165.527211:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788925165.527286:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a603ef7800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00080000:2.0:1788925165.527419:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff97a5035999c0) has no exports 00000020:00000080:2.0:1788925165.527425:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74231a5 00000020:00000080:2.0:1788925165.527429:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a503a18000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788925165.527758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503a18000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788925165.529157:0:20642:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788925165.529168:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788925165.529173:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788925165.529183:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788925165.529269:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925165.529304:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788925165.529348:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925165.529351:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788925165.529357:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a634e25000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788925165.529362:0:20642:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634e25000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788925165.529397:0:20642:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788925165.529686:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a503a1e000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788925165.529701:0:37:0:(genops.c:885:class_export_put()) final put ffff97a503a19800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788925165.529704:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503a19800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788925165.529711:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788925165.535230:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742317b 00000020:00000080:3.0:1788925165.535250:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a63f742000/lustre-MDD0000_UUID 00000020:01000000:3.0:1788925165.535279:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1788925165.535296:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788925165.535308:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788925165.535313:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff97a5038b19c0) has no exports 00000020:00000080:3.0:1788925165.535342:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925165.535350:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788925165.535354:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423182 00000020:00000080:3.0:1788925165.535359:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a63f740800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1788925165.535383:0:20642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a50429a000 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1788925165.535387:0:20642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a50429a000 3 00000020:01000004:3.0:1788925165.535390:0:20642:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a50429a000 from lustre-MDT0000 00000020:00000080:3.0:1788925165.535427:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925165.535432:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1788925165.535434:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a503bad000/lustre-MDT0000_UUID 00000020:00000080:3.0:1788925165.535438:0:20642:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503bad000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1788925165.535454:0:20642:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1788925165.535513:0:20642:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:3.0:1788925165.535517:0:20642:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1788925165.535520:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1788925165.535522:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788925165.535525:0:20642:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788925165.535532:0:20642:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff97a604c6d000 925113dd-c433-4b1b-8c21-0406d9c92f6b 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788925165.535538:0:20642:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff97a503598000) has exports, disconnecting them 00000020:00080000:3.0:1788925165.535543:0:20642:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff97a604c6d000), last request at 1788925053 00000020:00000080:3.0:1788925165.535577:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423127 00000020:00010000:3.0:1788925165.535581:0:20642:0:(genops.c:1920:obd_stale_export_put()) Put export ffff97a604c6d000: total 2 00000100:00080000:3.0:1788925165.535587:0:20642:0:(import.c:65:import_set_state_nolock()) ffff97a604c69000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788925165.535608:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a604c6d000): rc 0 00000020:00080000:3.0:1788925165.535612:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff97a503598000) has no exports 00000100:00100000:3.0:1788925165.535670:0:17062:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff97a618351000:17062] 0 exiting: rc = 1 00000100:00100000:3.0:1788925165.535869:0:17063:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff97a621a3a800:17063] 1 exiting: rc = 0 00000020:00010000:3.0:1788925165.535912:0:17057:0:(genops.c:1906:obd_stale_export_get()) Get export ffff97a604c6d000: total 2 00010000:00010000:3.0:1788925165.535917:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925165.535946:0:17057:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff97a604c6d000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788925165.535981:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a618379c00/0x45e32cfaf7423388 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf7423381 expref: 14 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.535997:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34d800/0x45e32cfaf7423517 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf7423510 expref: 13 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536011:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c436000/0x45e32cfaf7423556 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742354f expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536025:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34da00/0x45e32cfaf7423246 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742323f expref: 11 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536037:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34c600/0x45e32cfaf74233b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74233ab expref: 10 pid: 17064 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536050:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f07e00/0x45e32cfaf74236de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74236d7 expref: 9 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536060:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a618379a00/0x45e32cfaf7423303 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74232fc expref: 8 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536084:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34c800/0x45e32cfaf7423254 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742324d expref: 7 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536097:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06600/0x45e32cfaf74236ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74236e5 expref: 6 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536108:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a618379600/0x45e32cfaf7423262 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742325b expref: 5 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536119:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a61858ca00/0x45e32cfaf7423135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf742312e expref: 4 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536128:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c437800/0x45e32cfaf74234ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74234e6 expref: 3 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536140:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60a34d000/0x45e32cfaf74236fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x45e32cfaf74236f3 expref: 2 pid: 17063 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925165.536152:0:17057:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff97a604c6d000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788925165.536169:0:17057:0:(genops.c:885:class_export_put()) final put ffff97a604c6d000/925113dd-c433-4b1b-8c21-0406d9c92f6b 00010000:00010000:3.0:1788925165.536175:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925165.536177:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925165.536179:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925165.536215:0:17064:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff97a62ef7f400:17064] 2 exiting: rc = 0 00000100:00100000:3.0:1788925165.536300:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536311:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536318:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536324:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536330:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536338:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536354:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536360:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536366:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536382:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536389:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536395:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536428:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536436:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536442:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536448:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536454:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536460:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536466:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536473:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536479:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536485:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536492:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536498:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536503:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536508:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536515:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536521:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536526:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536532:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536538:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536544:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536552:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536558:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536564:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536570:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536575:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536581:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536586:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536592:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536597:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536612:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536618:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536624:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536630:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536635:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536641:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536648:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536653:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536658:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536664:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536670:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536676:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536681:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536687:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536693:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536699:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536705:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536710:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536715:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536728:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536734:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536740:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925165.536746:0:20642:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788925165.537366:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63f742000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788925165.537389:0:37:0:(genops.c:885:class_export_put()) final put ffff97a63f746000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788925165.537391:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63f746000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788925165.537397:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788925165.540311:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63f740800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788925165.540326:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604c6d000/925113dd-c433-4b1b-8c21-0406d9c92f6b for MGS 00000020:00000080:3.0:1788925165.540379:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604c69000 for MGS 00000020:01000000:3.0:1788925165.541193:0:20642:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a603e96cc0 - data ffff97a62a46bbd0/ffff97a502ba5c00 00000020:01000000:3.0:1788925165.541340:0:20642:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a5039495a0 - data ffff97a62a6960d8/ffff97a6358f8400 00000020:00000080:3.0:1788925165.542576:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742310b 00000020:00000080:3.0:1788925165.542611:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a50429b000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788925165.542646:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50429b000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:3.0:1788925165.542665:0:20642:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a50429a000 from MGS, refs=2 00000020:01000004:3.0:1788925165.542670:0:20642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a50429a000 2 00000020:01000004:3.0:1788925165.542673:0:20642:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a50429a000 from MGS 00000020:00000080:3.0:1788925165.542710:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925165.542796:0:20642:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1788925165.542800:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a50429c000/MGS 00000020:00000080:3.0:1788925165.542803:0:20642:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50429c000/MGS for MGS 00000020:01000000:3.0:1788925165.542810:0:20642:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1788925165.543248:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1788925165.543254:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788925165.543262:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788925165.543271:0:20642:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff97a608b37800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788925165.543278:0:20642:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff97a501f399c0) has exports, disconnecting them 00000020:00080000:3.0:1788925165.543285:0:20642:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff97a608b37800), last request at 1788925054 00000020:00000080:3.0:1788925165.543290:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742320e 00000020:00080000:3.0:1788925165.543308:0:20642:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a608b37800): rc 0 00000020:00000080:3.0:1788925165.543312:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a608b37800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788925165.543331:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a608b37800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788925165.555678:0:20642:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788925165.555697:0:20642:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925165.555701:0:20642:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788925165.555707:0:20642:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788925165.555895:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925165.555903:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788925165.555910:0:20642:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a50429a000 1 00000020:00000080:0.0:1788925165.555918:0:20642:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74230fd 00000020:00000080:0.0:1788925165.555926:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a504298000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788925165.555932:0:20642:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788925165.555936:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925165.555940:0:20642:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788925165.555943:0:20642:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff97a50359b380) has no exports 00000020:00000080:3.0:1788925165.558840:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a608b36000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788925165.558858:0:36:0:(genops.c:885:class_export_put()) final put ffff97a63cf5a000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788925165.558861:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a63cf5a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788925165.558870:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788925165.558967:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a504298000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788925165.718497:0:20642:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925165.718509:0:20642:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788925165.718515:0:20642:0:(genops.c:885:class_export_put()) final put ffff97a50429c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788925165.718519:0:20642:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50429c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788925165.718531:0:20642:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788925165.718654:0:20642:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a50429f800 00000020:02000400:0.0:1788925165.718707:0:20642:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788925165.742604:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470809344:0@lo:400:kworker.0 00000100:00100000:1.0:1788925165.742690:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.742722:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470809856:0@lo:400:kworker.0 00000100:00100000:1.0:1788925165.742746:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.742770:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925165.742777:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470809472:0@lo:400:kworker.0 00000100:00100000:1.0:1788925165.742800:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.742818:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470809984:0@lo:400:kworker.0 00000100:00100000:1.0:1788925165.742838:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925165.742869:0:17075:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809344 00000100:00100000:1.0:1788925165.742876:0:17075:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809344 00000100:00100000:1.0:1788925165.742911:0:17075:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788925165.742918:0:17075:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875823470809344:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788925165.742925:0:17075:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788925165.742958:0:17075:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3621:x1875823470809344:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788925165.742964:0:17075:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:1.0:1788925165.743019:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788925165.743024:0:3621:0:(import.c:65:import_set_state_nolock()) ffff97a50258e000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788925165.743028:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788925165.744562:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470809216:0@lo:400:kworker.0 00000400:00000100:2.0:1788925165.744608:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875823470809216 offset 0 length 224: 4 00000100:00100000:2.0:1788925165.744644:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470809728:0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.744675:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.744703:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1875823470810240:0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.744725:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.744746:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788925165.744753:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470809088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788925165.744775:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.744790:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470809600:0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.744811:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.744830:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1875823470810112:0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.744851:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.744876:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809856 00000100:00100000:2.0:1788925165.744884:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809856 00000100:00100000:2.0:1788925165.744914:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809984 00000100:00100000:2.0:1788925165.744917:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809984 00000100:00100000:2.0:1788925165.744944:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809728 00000100:00100000:2.0:1788925165.744947:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809728 00000100:00100000:2.0:1788925165.744955:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810240 00000100:00100000:2.0:1788925165.744970:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810240 00000100:00100000:2.0:1788925165.745005:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810112 00000100:00100000:2.0:1788925165.745008:0:17070:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810112 00000100:00100000:2.0:1788925165.745018:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788925165.745025:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470809984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.745071:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470809984:12345-0@lo:400:kworker.0 Request processed in 46us (2231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925165.745089:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788925165.746695:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788925165.746708:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875823470810240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.746772:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875823470810240:12345-0@lo:400:kworker.0 Request processed in 70us (2046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925165.746779:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788925165.746791:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925165.746795:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875823470809856:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788925165.746801:0:17070:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788925165.746824:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3621:x1875823470809856:12345-0@lo:400:kworker.0 Request processed in 27us (4076us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788925165.746829:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788925165.746840:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788925165.746844:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875823470809728:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788925165.746849:0:17070:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788925165.746869:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875823470809728:12345-0@lo:400:kworker.0 Request processed in 23us (2194us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788925165.746874:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788925165.746886:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788925165.746890:0:17070:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875823470810112:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788925165.746906:0:17070:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788925165.746930:0:17070:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3624:x1875823470810112:12345-0@lo:400:kworker.0 Request processed in 38us (2078us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788925165.746936:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788925165.746968:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809088 00000100:00100000:2.0:1788925165.746974:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809088 00000100:00100000:2.0:1788925165.747022:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925165.747028:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470809088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925165.747050:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925165.747083:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470809088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925165.747089:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925165.748447:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470809088:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788925165.748697:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788925165.748703:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788925165.748707:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788925165.748712:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925165.748716:0:3624:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1788925165.748725:0:3624:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a62e207000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925165.748754:0:3624:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a502830380 x1875823470810368/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925165.748783:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1875823470810112:0@lo:400:kworker.0 00000100:00080000:2.0:1788925165.748797:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788925165.748800:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a60773e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788925165.748815:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788925165.748818:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a60773e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925165.748822:0:3624:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:2.0:1788925165.749925:0:3624:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97a60773e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925165.749982:0:3624:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71ea00 x1875823470810496/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925165.749997:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470809728:0@lo:400:kworker.0 00010000:00080000:2.0:1788925165.750021:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5041cd180 x1875823470810240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925165.750032:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1875823470810240:0@lo:400:kworker.0 00000100:00100000:2.0:1788925165.750092:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470810368:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788925165.750431:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.750474:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875823470810496:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788925165.750498:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925165.750532:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810368 00000100:00100000:2.0:1788925165.750538:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810368 00000100:00100000:2.0:1788925165.750565:0:20211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810496 00000100:00100000:2.0:1788925165.750569:0:20211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810496 00000100:00100000:2.0:1788925165.750580:0:20211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788925165.750587:0:20211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1875823470810368:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788925165.750605:0:20211:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925165.754471:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809472 00000100:00100000:3.0:1788925165.754486:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809472 00000100:00100000:3.0:1788925165.754532:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470809600 00000100:00100000:3.0:1788925165.754536:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470809600 00000100:00100000:3.0:1788925165.754567:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788925165.754589:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470809472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925165.754594:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788925165.754604:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470810496:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1788925165.754676:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470809472:12345-0@lo:400:kworker.0 Request processed in 90us (11873us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925165.754683:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788925165.754701:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788925165.754708:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a602c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470809600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925165.754743:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a602c90700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470809600:12345-0@lo:400:kworker.0 Request processed in 37us (9932us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925165.754749:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788925165.754767:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788925165.754772:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925165.754774:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788925165.754821:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925165.754834:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470810624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788925165.754870:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925165.754904:0:18579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810624 00000100:00100000:3.0:1788925165.754908:0:18579:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810624 00000100:00100000:3.0:1788925165.754930:0:18579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788925165.754936:0:18579:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470810624:12345-0@lo:13:osp-pre-1-1.0 00010000:00020000:0.0:1788925165.754949:0:17069:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00002000:00000024:3.0:1788925165.754955:0:18579:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925165.755012:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470810496:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 407us (4512us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925165.755020:0:18579:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470810624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925165.755024:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788925165.755034:0:18579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788925165.755438:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470810624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788925165.755478:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470809600:0@lo:400:kworker.0 00000100:00080000:1.0:1788925165.758522:0:3621:0:(import.c:65:import_set_state_nolock()) ffff97a50258e000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925165.758532:0:3621:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 459 00000100:00080000:1.0:1788925165.758544:0:3621:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97a50258e000 using connection 192.168.206.151@tcp/0@lo 00000100:00080000:0.0:1788925165.759549:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a60773e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925165.759615:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788925165.759621:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875823470810496:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788925165.760026:0:3621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e350380 x1875823470810880/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925165.760057:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470809344:0@lo:400:kworker.0 00000100:00100000:0.0:1788925165.760071:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470810880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788925165.760129:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788925165.760182:0:3621:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788925165.760186:0:3621:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788925165.760190:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788925165.760195:0:3621:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925165.760198:0:3621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1788925165.760207:0:3621:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a5041e0800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925165.760220:0:3621:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e351500 x1875823470811008/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925165.760235:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470809856:0@lo:400:kworker.0 00000100:00100000:0.0:1788925165.760247:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925165.760258:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470811008:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788925165.760284:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925165.760313:0:17069:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811008 00000100:00100000:0.0:1788925165.760319:0:17069:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811008 00000100:00100000:0.0:1788925165.760347:0:17069:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788925165.760354:0:17069:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470811008:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:0.0:1788925165.760550:0:17069:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788925165.760984:0:17069:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470811008:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 628us (697us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788925165.760994:0:17069:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1788925165.761089:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925165.761093:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788925165.761097:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470811008:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:0.0:1788925165.761117:0:3621:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff97a62e353800 x1875823470810752/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925165.761140:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470809472:0@lo:400:kworker.0 00010000:00080000:0.0:1788925165.761153:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5041cfb80 x1875823470809984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925181 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925165.761161:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470809984:0@lo:400:kworker.0 00000100:00100000:3.0:1788925165.761722:0:17811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470810880 00000100:00100000:3.0:1788925165.761735:0:17811:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470810880 00000100:00100000:3.0:1788925165.761772:0:17811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788925165.761779:0:17811:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875823470810880:12345-0@lo:38:ptlrpcd_00_00.0 00010000:00020000:3.0:1788925165.761798:0:17811:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925165.761849:0:17811:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875823470810880:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 69us (1719us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925165.761856:0:17811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1788925165.761886:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a50258e000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925165.761891:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788925165.761894:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470810880:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:2.0:1788925165.779956:0:20211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3620:x1875823470810368:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 29363us (29521us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788925165.779967:0:20211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788925165.780009:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925165.780014:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788925165.780018:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470810368:0@lo:38:ptlrpcd_00_03.0 00000040:00080000:0.0:1788925165.995355:0:17824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788925166.124200:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925167.146916:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925168.172663:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788925168.818522:0:18572:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788925168.818531:0:18572:0:(genops.c:885:class_export_put()) final put ffff97a501f13800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788925168.818656:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a501f13800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1788925168.818711:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a501f16000 for lustre-OST0000 00010000:00010000:1.0:1788925169.194617:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788925169.200883:0:20843:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788925169.213551:0:20843:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:0.0:1788925169.213605:0:20843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.213620:0:20843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.213628:0:20843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.213635:0:20843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.213663:0:20843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925169.213668:0:20843:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788925169.213705:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.213709:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925169.213716:0:20843:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788925169.213722:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a60773e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788925169.213727:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.213729:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925169.213732:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788925169.213989:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925169.213997:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925169.214005:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a618378c00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925169.214009:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925169.214017:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925169.214035:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925169.214041:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788925169.214044:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788925169.214046:0:17058:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788925169.214080:0:17058:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925169.214086:0:17058:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925169.214113:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925169.214119:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a618378c00/0x45e32cfaf74232fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423303 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925169.214130:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925169.214132:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925169.214134:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925169.214151:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470811136:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925169.214216:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925169.214275:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811136 00000100:00100000:3.0:1788925169.214282:0:17055:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811136 00000100:00100000:3.0:1788925169.214318:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925169.214326:0:17055:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1875823470811136:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788925169.214332:0:17055:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788925169 with bad export cookie 5035918264732102951 00010000:00010000:0.0:1788925169.216782:0:20843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216801:0:20843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216809:0:20843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216817:0:20843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216846:0:20843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925169.216852:0:20843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216860:0:20843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216866:0:20843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216873:0:20843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216900:0:20843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788925169.216907:0:20843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216913:0:20843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216920:0:20843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216927:0:20843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216934:0:20843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788925169.216938:0:20843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216944:0:20843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216950:0:20843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216957:0:20843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925169.216963:0:20843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788925169.216966:0:20843:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788925169.216999:0:20843:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788925169.217003:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788925169.217008:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925169.217013:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788925169.217020:0:20843:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff97a5041e5800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925169.217026:0:20843:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff97a62e205000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925169.217031:0:20843:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff97a501f3cd40) has exports, disconnecting them 00000020:00080000:0.0:1788925169.217036:0:20843:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff97a5041e5800), last request at 1788925165 00000020:00000080:0.0:1788925169.217043:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423541 00000100:00080000:0.0:1788925169.217060:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a503bae800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788925169.217104:0:20843:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a5041e5800): rc 0 00000020:00000080:0.0:1788925169.217107:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a5041e5800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788925169.217124:0:20843:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff97a62e205000), last request at 1788925165 00000020:00000080:0.0:1788925169.217127:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74233dc 00000100:00080000:0.0:1788925169.217132:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a62e200000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788925169.217138:0:20843:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a62e205000): rc 0 00000020:00000080:0.0:1788925169.217140:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62e205000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788925169.217146:0:20843:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb64541c4fae0 00000100:00080000:0.0:1788925169.217162:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.217171:0:20843:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff97a62e353800 x1875823470810752/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925169.217184:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925169.218024:0:20843:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788925169.218031:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a50258e000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:2.0:1788925169.219254:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788925169.219264:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219274:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858dc00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925169.219278:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219288:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925169.219295:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925169.219300:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788925169.219303:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788925169.219306:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788925169.219369:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219377:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925169.219418:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219425:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a61858dc00/0x45e32cfaf742325b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423262 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219436:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788925169.219439:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219444:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a618378800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925169.219463:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219470:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925169.219475:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925169.219480:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788925169.219482:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788925169.219484:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788925169.219497:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219502:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925169.219514:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219520:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a618378800/0x45e32cfaf742354f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423556 expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219534:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788925169.219537:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219542:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984000 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925169.219544:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219551:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925169.219564:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925169.219569:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788925169.219571:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788925169.219573:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788925169.219587:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219593:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925169.219603:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219609:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a62d984000/0x45e32cfaf74236f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf74236fa expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219618:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925169.219621:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219626:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858c800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925169.219629:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219635:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925169.219641:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925169.219655:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788925169.219657:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788925169.219659:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788925169.219671:0:17057:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219677:0:17057:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925169.219682:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219687:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf742324d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x45e32cfaf7423254 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925169.219697:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925169.219698:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925169.219700:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925169.219720:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470811264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925169.219776:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925169.219823:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925169.219829:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470811648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925169.219851:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925169.219868:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470811520:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925169.219888:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925169.219899:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925169.219903:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470811392:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925169.219920:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925169.219941:0:17054:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788925169.219954:0:17054:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788925169.220064:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811264 00000100:00100000:2.0:1788925169.220071:0:17054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811264 00000100:00100000:2.0:1788925169.220099:0:17054:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788925169.220104:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811648 00000100:00100000:2.0:1788925169.220107:0:17054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811648 00000100:00100000:2.0:1788925169.220115:0:17054:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788925169.220120:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811520 00000100:00100000:2.0:1788925169.220122:0:17054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811520 00000100:00100000:2.0:1788925169.220128:0:17054:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788925169.220132:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811392 00000100:00100000:2.0:1788925169.220134:0:17054:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811392 00000100:00100000:2.0:1788925169.220212:0:20844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788925169.220219:0:20844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3624:x1875823470811264:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788925169.220224:0:20844:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788925169 with bad export cookie 5035918264732102951 00000100:00100000:2.0:1788925169.220266:0:20844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3624:x1875823470811264:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (489us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788925169.220272:0:20844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788925169.220305:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788925169.220309:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a502b54000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788925169.220313:0:3624:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000020:00000080:1.0:1788925169.226285:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e5800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:1.0:1788925169.226360:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62e205000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:1.0:1788925169.226384:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a503bae800 for lustre-MDT0001 00000020:00000080:1.0:1788925169.226388:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a62e200000 for lustre-MDT0001 00000100:00100000:1.0:1788925169.227039:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:0:1875823470810752:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788925169.229491:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788925169.229499:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788925169.229515:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788925169.229578:0:20843:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788925169.229621:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a604c29800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788925169.229647:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788925169.229649:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:0.0:1788925169.229659:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788925169.229730:0:20843:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788925169.229738:0:20843:0:(import.c:65:import_set_state_nolock()) ffff97a503ad9800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1788925169.229774:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff97a501f3cd40) has no exports 00000100:00100000:3.0:1788925169.237887:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470811776:0@lo:9:umount.0 00000100:00100000:3.0:1788925169.237962:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925169.238009:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470811904:0@lo:9:umount.0 00000100:00100000:3.0:1788925169.238030:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925169.238076:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925169.238083:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a504012850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3624:x1875823470811648:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788925169.238090:0:17056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788925169 with bad export cookie 5035918264732102951 00000100:00100000:3.0:1788925169.238126:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a504012850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3624:x1875823470811648:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (18274us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788925169.238133:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925169.238153:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925169.238158:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875823470811520:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788925169.238162:0:17056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788925169 with bad export cookie 5035918264732102951 00000100:00100000:3.0:1788925169.238189:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875823470811520:12345-0@lo:103:ldlm_bl.0 Request processed in 31us (18300us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788925169.238195:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925169.238205:0:17056:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925169.238209:0:17056:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875823470811392:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788925169.238213:0:17056:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788925169 with bad export cookie 5035918264732102951 00000100:00100000:3.0:1788925169.238235:0:17056:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3622:x1875823470811392:12345-0@lo:103:ldlm_bl.0 Request processed in 24us (18315us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788925169.238240:0:17056:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925169.238274:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811776 00000100:00100000:3.0:1788925169.238281:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811776 00000100:00100000:3.0:1788925169.238321:0:18952:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470811904 00000100:00100000:3.0:1788925169.238324:0:18952:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470811904 00000100:00100000:3.0:1788925169.238342:0:18952:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788925169.238348:0:18952:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3620:x1875823470811776:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788925169.238381:0:18952:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423406 00000100:00080000:3.0:1788925169.238396:0:18952:0:(import.c:65:import_set_state_nolock()) ffff97a50383f800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788925169.239500:0:18576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788925169.239512:0:18576:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1875823470811904:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788925169.239532:0:18576:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423572 00000100:00080000:0.0:1788925169.239540:0:18576:0:(import.c:65:import_set_state_nolock()) ffff97a604184000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788925169.239568:0:18576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934599 00000100:00100000:0.0:1788925169.239719:0:18576:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+2:3620:x1875823470811904:12345-0@lo:9:umount.0 Request processed in 210us (1686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925169.239727:0:18576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788925169.239755:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925169.239759:0:17065:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925169.239785:0:3622:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000001:00000004:3.0:1788925169.240389:0:18952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788925169.240541:0:18952:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3620:x1875823470811776:12345-0@lo:9:umount.0 Request processed in 2192us (2577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925169.240548:0:18952:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788925169.240573:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788925169.240597:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a604c29800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788925169.240615:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788925169.240617:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788925169.240620:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470811776:0@lo:9:umount.0 00000100:00080000:3.0:1788925169.240632:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a503ad9800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788925169.240641:0:3620:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788925169.240643:0:3620:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788925169.240645:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470811904:0@lo:9:umount.0 00010000:00010000:1.0:1788925169.241850:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925169.244920:0:17055:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3623:x1875823470811136:12345-0@lo:103:ldlm_bl.0 Request processed in 30586us (30696us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788925169.244935:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788925169.245057:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788925169.250280:0:3624:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.151@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788925169.250286:0:3624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788925169.250296:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a5041cf800 x1875823470809216/t0(0) o400->MGC192.168.206.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788925181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925169.250311:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e35a300 x1875823470811136/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788925185 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925169.250321:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71f800 x1875823470811264/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788925185 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925169.250329:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71e680 x1875823470811648/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788925185 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925169.250370:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71f480 x1875823470811520/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788925185 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925169.250378:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71c380 x1875823470811392/t0(0) o103->MGC192.168.206.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788925185 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788925169.250386:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788925169.250388:0:3624:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788925169.250390:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788925169.250599:0:3622:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97a502b54000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1788925169.250623:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470811520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925169.250649:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:925113dd-c433-4b1b-8c21-0406d9c92f6b:3622:1875823470811392:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788925169.250815:0:3623:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff97a502b54000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788925169.250827:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:925113dd-c433-4b1b-8c21-0406d9c92f6b:3623:1875823470811136:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788925169.250871:0:3624:0:(import.c:65:import_set_state_nolock()) ffff97a502b54000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925169.250876:0:3624:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 439 00000100:00080000:2.0:1788925169.250888:0:3624:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff97a502b54000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925169.250929:0:3624:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71d180 x1875823470812032/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925169.250960:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470809216:0@lo:400:kworker.0 00000100:00100000:2.0:1788925169.250973:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470811648:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925169.250978:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:925113dd-c433-4b1b-8c21-0406d9c92f6b:3624:1875823470811264:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925169.251021:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925113dd-c433-4b1b-8c21-0406d9c92f6b:3620:1875823470812032:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788925169.251061:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875823470812032 offset 0 length 520: 4 00000020:00080000:1.0:1788925169.257070:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff97a501f3cd40) has no exports 00000020:01000000:2.0:1788925169.304879:0:20843:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a60ac6ad20 - data ffff97a62a67abd0/ffff97a5035bf400 00000020:01000000:2.0:1788925169.305037:0:20843:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a503541300 - data ffff97a5020e4a20/ffff97a6077a9000 00000001:00000004:2.0:1788925169.313918:0:20843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:0.0:1788925169.359081:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.359099:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925169.359108:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788925169.365093:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788925169.365100:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:0.0:1788925169.365186:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788925169.365204:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788925169.378897:0:17812:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788925169.378904:0:17812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:1.0:1788925169.378915:0:17812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1788925169.379570:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788925169.379575:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1788925169.379595:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925169.379598:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788925169.380382:0:17814:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788925169.380387:0:17814:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1788925169.380396:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1788925169.383966:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423270 00000020:00000080:2.0:1788925169.383978:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a50272d000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788925169.384140:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50272d000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:2.0:1788925169.384641:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423285 00000020:00000080:2.0:1788925169.384647:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62d9ef800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788925169.384674:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1788925169.384679:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925169.384688:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788925169.384693:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff97a501f3b380) has no exports 00000004:01000000:2.0:1788925169.384842:0:20843:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788925169.384851:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232d9 00000020:00000080:2.0:1788925169.384855:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a503add000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788925169.384858:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788925169.384860:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62d9ef800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:2.0:1788925169.384862:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925169.384866:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00000080:1.0:1788925169.384867:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503add000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00080000:2.0:1788925169.384869:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff97a60ac93380) has no exports 00000020:00000080:2.0:1788925169.384873:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232d2 00000020:00000080:2.0:1788925169.384877:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a503ade000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788925169.384907:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503ade000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788925169.385214:0:20843:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788925169.385219:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788925169.385223:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788925169.385229:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925169.385231:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788925169.385270:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788925169.385277:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788925169.385282:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232c4 00000020:00000080:2.0:1788925169.385287:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a503adb000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788925169.385291:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1788925169.385294:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925169.385297:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788925169.385299:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff97a503740000) has no exports 00000020:00000080:2.0:1788925169.385303:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232bd 00000020:00000080:2.0:1788925169.385305:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a5039bc800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788925169.385380:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a503ad9800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1788925169.385386:0:37:0:(genops.c:885:class_export_put()) final put ffff97a503adb800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788925169.385388:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503adb800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1788925169.385393:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788925169.385476:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503adb000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788925169.385481:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5039bc800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:2.0:1788925169.385656:0:20843:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1788925169.385659:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788925169.385662:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1788925169.385665:0:20843:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788925169.385673:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788925169.385708:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788925169.385713:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1788925169.385722:0:20843:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788925169.385726:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232a8 00000020:00000080:2.0:1788925169.385731:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a604ed7000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1788925169.385735:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1788925169.385738:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925169.385742:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788925169.385744:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff97a503743380) has no exports 00000020:00000080:2.0:1788925169.385749:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74232a1 00000020:00000080:2.0:1788925169.385752:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a502588000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788925169.385772:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604c29800 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1788925169.385778:0:37:0:(genops.c:885:class_export_put()) final put ffff97a5039bd000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788925169.385786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5039bd000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1788925169.385790:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788925169.385822:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604ed7000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788925169.385826:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a502588000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788925169.390985:0:20843:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788925169.390997:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.391001:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788925169.391009:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788925169.391052:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.391064:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788925169.391076:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50258e000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1788925169.391086:0:37:0:(genops.c:885:class_export_put()) final put ffff97a502589800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788925169.391089:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a502589800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:0.0:1788925169.391091:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.391095:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788925169.391096:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788925169.391098:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62d9eb000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788925169.391100:0:20843:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62d9eb000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788925169.391110:0:20843:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788925169.398871:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742328c 00000020:00000080:0.0:1788925169.398887:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62d9ec000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788925169.399000:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788925169.399009:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925169.399019:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788925169.399023:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff97a501f38000) has no exports 00000020:00000080:0.0:1788925169.399047:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.399053:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788925169.399058:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423293 00000020:00000080:0.0:1788925169.399062:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62d9ea800/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788925169.400566:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62d9ec000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1788925169.400575:0:37:0:(genops.c:885:class_export_put()) final put ffff97a50272c000/lustre-MDD0001_UUID 00000020:00000080:1.0:1788925169.400577:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50272c000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1788925169.400585:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1788925169.403326:0:20843:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a62d9e8800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788925169.403335:0:20843:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a62d9e8800 2 00000020:00000080:1.0:1788925169.403443:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62d9ea800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000004:0.0:1788925169.403714:0:20843:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a62d9e8800 from lustre-MDT0001 00000020:00000080:0.0:1788925169.403747:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.403757:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788925169.403762:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a502728000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788925169.403765:0:20843:0:(genops.c:844:class_export_destroy()) destroying export ffff97a502728000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788925169.403772:0:20843:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788925169.403837:0:20843:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788925169.403841:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788925169.403855:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925169.403860:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788925169.403866:0:20843:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff97a607739000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925169.403872:0:20843:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff97a607660000) has exports, disconnecting them 00000020:00080000:0.0:1788925169.403877:0:20843:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff97a607739000), last request at 1788925073 00000020:00000080:0.0:1788925169.403882:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423311 00000020:00080000:0.0:1788925169.403893:0:20843:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a607739000): rc 0 00000020:00000080:0.0:1788925169.403897:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a607739000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1788925169.406590:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a607739000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:0.0:1788925169.444209:0:20843:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:0.0:1788925169.444217:0:20843:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925169.444222:0:20843:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788925169.444229:0:20843:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788925169.444386:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a60773e800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:0.0:1788925169.444717:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.444727:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:0.0:1788925169.444732:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a607738800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:0.0:1788925169.444736:0:20843:0:(genops.c:844:class_export_destroy()) destroying export ffff97a607738800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:0.0:1788925169.444744:0:20843:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:0.0:1788925169.444807:0:20843:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a62d9e8800 1 00000020:00000080:0.0:1788925169.444813:0:20843:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423238 00000020:00000080:0.0:1788925169.444818:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a604ed7800/lustre-MDT0001-osd_UUID 00000020:01000000:0.0:1788925169.444836:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:0.0:1788925169.444841:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925169.444845:0:20843:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788925169.444849:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff97a63599cd40) has no exports 00000020:00000080:1.0:1788925169.446251:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604ed7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788925169.625425:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925169.625438:0:20843:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788925169.625443:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a62d9ea000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788925169.625771:0:20843:0:(genops.c:844:class_export_destroy()) destroying export ffff97a62d9ea000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788925169.625780:0:20843:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788925169.625903:0:20843:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a62d9ed800 00000020:01000000:0.0:1788925169.625934:0:20843:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788925169.625938:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925169.625942:0:20843:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788925169.625946:0:20843:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff97a5038b3380) has no exports 00000100:00100000:3.0:1788925169.626102:0:17071:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff97a634ee1000:17071] 2 exiting: rc = 0 00000100:00100000:3.0:1788925169.626242:0:20211:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff97a5037a0800:20211] 3 exiting: rc = 0 00000100:00100000:1.0:1788925169.626756:0:17069:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff97a634ee0200:17069] 0 exiting: rc = 1 00000100:00100000:1.0:1788925169.626815:0:17070:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff97a634ee1400:17070] 1 exiting: rc = 0 00000100:00100000:0.0:1788925169.626986:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.626994:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627000:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627005:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627010:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627015:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627020:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627025:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627030:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627035:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627039:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627043:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627049:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627053:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627059:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627064:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627070:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627075:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627080:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627085:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627090:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627095:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627100:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627105:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627110:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627115:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627120:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627126:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627140:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627147:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627152:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627168:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627174:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627178:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627183:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627189:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627194:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627199:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627204:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627209:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627215:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627220:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627225:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627230:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627235:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627240:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627245:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627250:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627258:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627263:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627268:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627273:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627279:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627284:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627289:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627295:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627300:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627306:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627311:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627316:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627322:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627327:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627332:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.627338:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925169.631428:0:17072:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff97a604e0bc00:17072] 0 exiting: rc = 1 00000100:00100000:1.0:1788925169.635029:0:17073:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff97a604e0a600:17073] 1 exiting: rc = 0 00000100:00100000:0.0:1788925169.641542:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641554:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641576:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641583:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641589:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641594:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641600:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641606:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641611:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641616:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641622:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641627:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641633:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641638:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641643:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641649:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641654:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641660:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641665:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641671:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641676:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641682:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641688:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641694:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641699:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641704:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641710:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641715:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641721:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641726:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641731:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641737:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641742:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641747:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641752:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641757:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641761:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641774:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641780:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641786:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641791:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641797:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641802:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641808:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641813:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641819:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641824:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641829:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641835:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641840:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641845:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641851:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641856:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641860:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641865:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641871:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641876:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641881:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641886:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641891:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641897:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641901:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641905:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.641911:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925169.642459:0:17811:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff97a503ad2400:17811] 2 exiting: rc = 0 00000100:00100000:1.0:1788925169.642459:0:17074:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff97a634ee1200:17074] 0 exiting: rc = 1 00000100:00100000:0.0:1788925169.644008:0:17075:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff97a610e99600:17075] 1 exiting: rc = 0 00000100:00100000:2.0:1788925169.644146:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644156:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644161:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644166:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644171:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644177:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644182:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644205:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644212:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644217:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644223:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644229:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644235:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644241:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644246:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644252:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644259:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644264:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644271:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644292:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644300:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644306:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644312:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644337:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644343:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644359:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644365:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644372:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644378:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644384:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644388:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644431:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644441:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644457:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644465:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644478:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644484:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644491:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644501:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644507:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644514:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644519:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644525:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644549:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644557:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644563:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644569:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644574:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644581:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644587:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644593:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644599:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644604:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644610:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644616:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644637:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644645:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644650:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644663:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644674:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644691:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644698:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644704:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.644710:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925169.655162:0:17077:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff97a634e9b200:17077] 1 exiting: rc = 0 00000100:00100000:1.0:1788925169.655727:0:17076:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff97a634e9aa00:17076] 0 exiting: rc = 1 00000100:00100000:2.0:1788925169.656973:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.656983:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.656988:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.656993:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.656999:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657006:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657011:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657016:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657021:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657027:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657032:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657037:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657043:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657048:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657054:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657059:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657065:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657070:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657075:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657080:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657088:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657092:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657098:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657102:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657107:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657112:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657117:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657121:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657125:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657144:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657149:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657155:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657160:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657164:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657170:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657175:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657180:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657185:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657190:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657195:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657200:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657205:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657210:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657216:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657221:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657226:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657232:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657237:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657242:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657248:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657253:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657259:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657264:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657269:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657274:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657279:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657284:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657289:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657294:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657300:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657305:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657310:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657315:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.657320:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925169.658051:0:17078:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff97a626112000:17078] 0 exiting: rc = 1 00000100:00100000:1.0:1788925169.658052:0:17079:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff97a63ce6e200:17079] 1 exiting: rc = 0 00000100:00100000:2.0:1788925169.658161:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658167:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658173:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658178:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658184:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658188:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658193:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658198:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658203:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658208:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658213:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658218:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658223:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658228:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658233:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658238:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658243:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658247:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658252:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658257:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658263:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658268:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658274:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658280:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658285:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658291:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658296:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658302:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658307:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658313:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658319:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658324:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658329:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658335:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658739:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658757:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658763:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658768:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658773:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658778:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658782:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658787:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658791:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658796:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658801:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658806:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658810:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658815:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658820:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658825:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658830:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658836:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658841:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658847:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658852:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658857:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658862:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658868:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658873:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658878:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658883:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658887:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658892:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.658896:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925169.659272:0:17080:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff97a62118fa00:17080] 0 exiting: rc = 1 00000100:00100000:3.0:1788925169.659990:0:17081:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff97a63ce6fe00:17081] 1 exiting: rc = 0 00000100:00100000:2.0:1788925169.660062:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660069:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660075:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660080:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660085:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660090:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660112:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660117:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660123:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660128:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660133:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660137:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660142:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660147:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660151:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660158:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660163:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660168:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660172:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660176:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660180:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660184:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660189:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660193:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660197:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660201:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660206:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660210:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660214:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660218:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660222:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660226:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660231:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660234:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660238:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660242:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660246:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660250:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660254:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660259:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660263:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660271:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660275:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660280:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660284:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660289:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660293:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660298:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660302:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660306:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660311:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660315:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660319:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660324:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660328:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660332:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660336:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660360:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660365:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660369:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660373:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660378:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660382:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.660386:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788925169.660868:0:17082:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff97a60ad39600:17082] 0 exiting: rc = 1 00000100:00100000:2.0:1788925169.660872:0:17084:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff97a60ad39400:17084] 2 exiting: rc = 0 00000100:00100000:3.0:1788925169.661367:0:17083:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff97a5029bec00:17083] 1 exiting: rc = 0 00000100:00100000:2.0:1788925169.661470:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661480:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661486:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661492:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661504:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661510:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661516:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661521:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661526:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661531:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661536:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661547:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661553:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661558:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661563:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661567:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661572:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661578:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661583:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661588:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661593:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661609:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661614:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661619:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661624:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661629:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661716:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661726:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661732:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661738:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661744:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661753:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661759:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661765:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661770:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661775:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661781:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661786:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661792:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661797:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661803:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661808:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661813:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661818:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661830:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661884:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661896:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661901:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661907:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661913:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661924:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661930:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661936:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661942:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661947:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661952:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661958:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661964:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661969:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661974:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661980:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661987:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661993:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925169.661998:0:20843:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788925169.668231:0:20843:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788925169.668245:0:20843:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788925169.668251:0:20843:0:(genops.c:885:class_export_put()) final put ffff97a634e22800/MDS_uuid 00000020:00000080:2.0:1788925169.668255:0:20843:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634e22800/MDS_uuid for MDS 00000020:01000000:2.0:1788925169.668260:0:20843:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788925169.668517:0:20843:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1788925170.223575:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925170.859543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925170.859553:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788925170.859556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925170.859575:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788925170.859579:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925170.859586:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 551 00000100:00080000:0.0:1788925170.859591:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788925170.859603:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a5041e0800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925170.859641:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e353b80 x1875823470812160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925170.860211:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470812160:0@lo:38:kworker.0 00000400:00000100:1.0:1788925170.860264:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812160 offset 0 length 520: 4 00000100:00080000:0.0:1788925170.869238:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925170.869247:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788925170.869250:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925170.869258:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 551 00000100:00080000:0.0:1788925170.869265:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788925170.869280:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a62e207000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925170.869318:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e351c00 x1875823470812416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925170.869389:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925170.869431:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470812288:0@lo:400:kworker.0 00000400:00000100:0.0:1788925170.869478:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812288 offset 0 length 224: 4 00000100:00100000:0.0:1788925170.869519:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470812416:0@lo:38:kworker.0 00000400:00000100:0.0:1788925170.869536:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812416 offset 0 length 520: 4 00000100:00100000:0.0:1788925170.869558:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470812544:0@lo:400:kworker.0 00000400:00000100:0.0:1788925170.869574:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812544 offset 0 length 224: 4 00010000:00010000:3.0:1788925171.246726:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925172.279708:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925173.291648:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788925173.948236:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788925173.948258:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925173.948261:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788925173.948264:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925173.948315:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788925173.948318:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925173.948376:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470812800:0@lo:400:kworker.0 00000400:00000100:1.0:1788925173.948446:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812800 offset 0 length 224: 4 00000100:00100000:0.0:1788925173.948606:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470812672:0@lo:400:kworker.0 00000400:00000100:0.0:1788925173.948639:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812672 offset 0 length 224: 4 00010000:00010000:0.0:1788925174.316172:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788925174.443214:0:21045:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788925174.471839:0:21045:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788925174.471893:0:21045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.471909:0:21045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.471917:0:21045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.471925:0:21045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925174.471985:0:21045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925174.471991:0:21045:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788925174.472017:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925174.472026:0:21045:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e353b80 x1875823470812160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925185 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925174.472046:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925174.472052:0:21045:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788925174.472058:0:21045:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788925174.472063:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925174.472067:0:21045:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e353b80 x1875823470812160/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925185 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925174.472074:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925174.472077:0:21045:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:1.0:1788925174.473581:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470812160:0@lo:38:kworker.0 00000100:00080000:0.0:1788925174.474752:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788925174.474766:0:21045:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e351f80 x1875823470812288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925186 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925174.474831:0:21045:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a5039b0000 x1875823470812672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925174.474847:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925174.474853:0:21045:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788925174.474876:0:21045:0:(import.c:65:import_set_state_nolock()) ffff97a50383e000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788925174.474959:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470812672:0@lo:400:kworker.0 00000100:00100000:0.0:1788925174.476693:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1875823470812928:0@lo:39:umount.0 00000400:00000100:0.0:1788925174.476751:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470812928 offset 0 length 224: 4 00010000:00010000:3.0:1788925174.476864:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925174.476873:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.476883:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60a34d200 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925174.476888:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.476898:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925174.476905:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925174.476911:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788925174.476914:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788925174.476917:0:17058:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788925174.476932:0:17058:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:3.0:1788925174.476936:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925174.476943:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60a34d200/0x45e32cfaf74233ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74233b2 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925174.477013:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.477016:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925174.477018:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925174.477177:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470812288:0@lo:400:kworker.0 00000001:00100000:2.0:1788925174.957461:0:19392:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788925174.957477:0:19392:0:(genops.c:885:class_export_put()) final put ffff97a604185000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788925174.957536:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604185000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788925174.957582:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a604184000 for lustre-OST0001 00000001:00100000:3.0:1788925174.957857:0:18572:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788925174.957861:0:18572:0:(genops.c:885:class_export_put()) final put ffff97a50383b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788925174.957923:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50383b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788925174.957959:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50383f800 for lustre-OST0000 00010000:00010000:0.0:1788925175.338712:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925175.981606:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925175.981616:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788925175.981619:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925175.981622:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788925175.981800:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925175.981820:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470813056:0@lo:400:kworker.0 00000400:00000100:3.0:1788925175.981884:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813056 offset 0 length 224: 4 00010000:00010000:2.0:1788925176.362684:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925177.386666:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925178.412081:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925179.434694:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925179.626676:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925169/real 1788925169] req@ffff97a63c71d180 x1875823470812032/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788925179 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925179.626709:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a63c71d180 x1875823470812032/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788925179 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925179.626730:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a502b54000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925179.626753:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788925179.626758:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925113dd-c433-4b1b-8c21-0406d9c92f6b:3620:1875823470812032:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1788925179.627106:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788925179.627112:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788925179.627114:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a502b54000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925179.627119:0:16480:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 555 00000100:00080000:3.0:1788925179.627124:0:16480:0:(import.c:630:import_select_connection()) MGC192.168.206.151@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788925179.627134:0:16480:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff97a502b54000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925179.627161:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e35a300 x1875823470813184/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925179.627201:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788925179.627205:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925179.627306:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470813312:0@lo:400:kworker.0 00000400:00000100:1.0:1788925179.627352:0:3621:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813312 offset 0 length 224: 4 00000100:00100000:0.0:1788925179.627558:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925113dd-c433-4b1b-8c21-0406d9c92f6b:3620:1875823470813184:0@lo:250:kworker.0 00000400:00000100:0.0:1788925179.627578:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875823470813184 offset 0 length 520: 4 00010000:00010000:2.0:1788925180.458745:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925181.483209:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925182.506589:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925183.533743:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925184.555538:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925184.682832:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925184.682846:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788925184.682850:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925184.682854:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788925184.683036:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470813440:0@lo:400:kworker.0 00000400:00000100:2.0:1788925184.683104:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813440 offset 0 length 224: 4 00000100:00100000:0.0:1788925184.746594:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925174/real 1788925174] req@ffff97a62e351880 x1875823470812928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788925184 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925184.746629:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a62e351880 x1875823470812928/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788925184 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925184.746649:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a50383e000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788925184.746675:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1875823470812928:0@lo:39:umount.0 00000100:00080000:2.0:1788925184.746876:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788925184.746881:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788925184.746885:0:21045:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788925184.748099:0:21045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748116:0:21045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748124:0:21045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748130:0:21045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748229:0:21045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925184.748238:0:21045:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748246:0:21045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748252:0:21045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925184.748290:0:21045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755052:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925184.755077:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755090:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60a34cc00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925184.755095:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755106:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925184.755114:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925184.755137:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788925184.755140:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1788925184.755155:0:17057:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:3.0:1788925184.755159:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755165:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60a34cc00/0x45e32cfaf7423381 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423388 expref: -99 pid: 18571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755184:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925184.755189:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755195:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06200 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925184.755198:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755204:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925184.755210:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925184.755215:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788925184.755218:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1788925184.755222:0:17057:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:3.0:1788925184.755225:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925184.755242:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925184.755244:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925184.755246:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925184.760668:0:21045:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788925184.760685:0:21045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a501f06200/0x45e32cfaf74236e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74236ec expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925184.760704:0:21045:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788925184.760715:0:21045:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:2.0:1788925184.760718:0:21045:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:2.0:1788925184.760755:0:21045:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:2.0:1788925184.760759:0:21045:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:2.0:1788925184.761079:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788925184.761086:0:21045:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788925184.761090:0:21045:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff97a6359999c0) has no exports 00000020:00080000:2.0:1788925184.761115:0:21045:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff97a6359999c0) has no exports 00010000:00010000:1.0:1788925184.762497:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788925184.770943:0:21045:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a501fbcde0 - data ffff97a62a581360/ffff97a62e2b9000 00000020:01000000:0.0:1788925184.771726:0:21045:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a5037d3180 - data ffff97a62a5be1b0/ffff97a5041fac00 00100000:10000000:0.0:1788925184.792243:0:21045:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788925184.811139:0:21045:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423396 00000020:00000080:1.0:1788925184.811155:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a604180800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788925184.811661:0:21045:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a604191000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788925184.811668:0:21045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a604191000 2 00000020:01000004:1.0:1788925184.811672:0:21045:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a604191000 from lustre-OST0000 00000020:00000080:1.0:1788925184.811711:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925184.811724:0:21045:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788925184.811728:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a604187000/lustre-OST0000_UUID 00000020:00000080:1.0:1788925184.811732:0:21045:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604187000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788925184.811741:0:21045:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:2.0:1788925184.814980:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604180800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:1.0:1788925184.815350:0:21045:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788925184.815359:0:21045:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788925184.815367:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925184.815388:0:21045:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788925184.815395:0:21045:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff97a50383b800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788925184.815431:0:21045:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff97a607663380) has exports, disconnecting them 00000020:00080000:1.0:1788925184.815438:0:21045:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff97a50383b800), last request at 1788925090 00000020:00000080:1.0:1788925184.815442:0:21045:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74233c0 00000020:00080000:1.0:1788925184.815461:0:21045:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a50383b800): rc 0 00000020:00000080:1.0:1788925184.815466:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a50383b800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788925184.815651:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50383b800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788925184.834209:0:21045:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788925184.834222:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925184.834227:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788925184.834237:0:21045:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788925184.834332:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a5041e0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788925184.834978:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925184.835152:0:21045:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788925184.835158:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a5041e6800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788925184.835162:0:21045:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e6800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788925184.835184:0:21045:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:0.0:1788925184.835250:0:21045:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788925184.835253:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925184.835258:0:21045:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788925184.835264:0:21045:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff97a50383d800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788925184.835285:0:21045:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff97a503b1b380) has exports, disconnecting them 00000020:00080000:0.0:1788925184.835290:0:21045:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff97a50383d800), last request at 1788925090 00000020:00000080:0.0:1788925184.835294:0:21045:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74233d5 00000020:00080000:0.0:1788925184.835310:0:21045:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a50383d800): rc 0 00000020:00000080:0.0:1788925184.835314:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a50383d800/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788925184.835390:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50383d800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788925184.836579:0:21045:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788925184.836586:0:21045:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788925184.836589:0:21045:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788925184.836596:0:21045:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788925184.836669:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a50383e000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788925184.836791:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925184.836801:0:21045:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788925184.836805:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a50383a800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788925184.836808:0:21045:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50383a800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788925184.836814:0:21045:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788925184.836864:0:21045:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a604191000 1 00000020:00000080:0.0:1788925184.836870:0:21045:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423373 00000020:00000080:0.0:1788925184.836875:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a604197000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788925184.836888:0:21045:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788925184.836891:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925184.836895:0:21045:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788925184.836899:0:21045:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff97a607664d40) has no exports 00000020:00000080:3.0:1788925184.836932:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604197000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788925184.889249:0:21045:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788925184.889263:0:21045:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788925184.889285:0:21045:0:(genops.c:885:class_export_put()) final put ffff97a604196800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788925184.889300:0:21045:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604196800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788925184.889311:0:21045:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788925184.889456:0:21045:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a604197800 00000020:02000400:0.0:1788925184.889501:0:21045:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788925185.579892:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925185.771361:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925170/real 1788925170] req@ffff97a62e351c00 x1875823470812416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788925185 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925185.771396:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a62e351c00 x1875823470812416/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788925185 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788925185.771448:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925185.771462:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788925185.771467:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470812416:0@lo:38:kworker.0 00000100:00080000:0.0:1788925185.771591:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925185.771596:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788925185.771599:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788925185.771602:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788925185.771605:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925185.771610:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 557 00000100:00080000:0.0:1788925185.771615:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788925185.771628:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a62e207000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925185.771662:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e351880 x1875823470813568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925185.771728:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925185.771740:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1875823470813696:0@lo:400:kworker.0 00000400:00000100:0.0:1788925185.771788:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813696 offset 0 length 224: 4 00000100:00100000:1.0:1788925185.772021:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470813568:0@lo:38:kworker.0 00000400:00000100:1.0:1788925185.772045:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813568 offset 0 length 520: 4 00010000:00010000:1.0:1788925186.602712:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:3.0:1788925186.797809:0:3621:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925170/real 1788925170] req@ffff97a62e350700 x1875823470812544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788925186 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925186.855594:0:3621:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff97a62e350700 x1875823470812544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788925186 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788925186.855609:0:3621:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788925186.855613:0:3621:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1788925186.896101:0:3621:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:2.0:1788925186.896972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788925186.896980:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925186.896984:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788925186.896987:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925186.896989:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788925186.896992:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788925186.896996:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925186.897004:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 495 00000100:00080000:2.0:1788925186.897047:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff97a5041e0000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925186.897087:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71f800 x1875823470813824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925186.897136:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1875823470813824:0@lo:38:kworker.0 00000400:00000100:2.0:1788925186.897215:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875823470813824 offset 0 length 520: 4 00000100:00100000:1.0:1788925186.897875:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470812544:0@lo:400:kworker.0 00010000:00010000:0.0:1788925187.635453:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925188.650638:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788925189.148377:0:21247:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1788925189.167457:0:21247:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788925189.167536:0:21247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.167563:0:21247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.167572:0:21247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.167592:0:21247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.167613:0:21247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788925189.167618:0:21247:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788925189.167643:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925189.167654:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e351880 x1875823470813568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925205 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.167672:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925189.167678:0:21247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788925189.167684:0:21247:0:(import.c:65:import_set_state_nolock()) ffff97a62e207000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788925189.167689:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788925189.167692:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e351880 x1875823470813568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925205 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.167700:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925189.167703:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:2.0:1788925189.167852:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470813568:0@lo:38:kworker.0 00010000:00010000:3.0:1788925189.167989:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925189.167996:0:17057:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925189.168003:0:17057:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a618378600 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925189.168006:0:17057:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925189.168013:0:17057:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925189.168031:0:17057:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925189.168036:0:17057:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788925189.168039:0:17057:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788925189.168042:0:17057:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788925189.168053:0:17057:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:3.0:1788925189.168057:0:17057:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925189.168062:0:17057:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a618378600/0x45e32cfaf7423510 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423517 expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925189.168073:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925189.168075:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925189.168076:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788925189.169580:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788925189.169593:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a5039b0a80 x1875823470812800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925189 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169613:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e351f80 x1875823470813056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925191 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169622:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e359500 x1875823470813312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925195 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169638:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e353b80 x1875823470813440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925200 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169655:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e352300 x1875823470813696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925201 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169678:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71f800 x1875823470813824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925196 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169688:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788925189.169693:0:21247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788925189.169710:0:21247:0:(import.c:65:import_set_state_nolock()) ffff97a5041e0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788925189.169715:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788925189.169718:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a5039b0a80 x1875823470812800/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925189 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169726:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e351f80 x1875823470813056/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925191 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169733:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e359500 x1875823470813312/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925195 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169740:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e353b80 x1875823470813440/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925200 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169746:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e352300 x1875823470813696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925201 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169752:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a63c71f800 x1875823470813824/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788925196 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925189.169758:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788925189.169761:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:3.0:1788925189.169847:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470813312:0@lo:400:kworker.0 00000100:00100000:3.0:1788925189.169900:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470813440:0@lo:400:kworker.0 00000100:00100000:3.0:1788925189.169925:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1875823470813824:0@lo:38:kworker.0 00000100:00100000:1.0:1788925189.170333:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470813056:0@lo:400:kworker.0 00000100:00100000:1.0:1788925189.170353:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470812800:0@lo:400:kworker.0 00000100:00100000:1.0:1788925189.170386:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e352300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3624:1875823470813696:0@lo:400:kworker.0 00010000:00010000:0.0:1788925189.171922:0:21247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.171939:0:21247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.171947:0:21247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.171968:0:21247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.172029:0:21247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925189.172038:0:21247:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.172046:0:21247:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.172052:0:21247:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925189.172058:0:21247:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172223:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925189.172254:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172261:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60a34ca00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925189.172264:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172272:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925189.172279:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925189.172284:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788925189.172286:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:1.0:1788925189.172296:0:17058:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:1.0:1788925189.172300:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172307:0:17058:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60a34ca00/0x45e32cfaf74234e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74234ed expref: -99 pid: 19391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172321:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925189.172324:0:17058:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172330:0:17058:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436200 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925189.172333:0:17058:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172339:0:17058:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925189.172352:0:17058:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925189.172356:0:17058:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788925189.172358:0:17058:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788925189.172363:0:17058:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:1.0:1788925189.172366:0:17058:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.172373:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925189.172375:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925189.172377:0:17058:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925189.175781:0:21247:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788925189.175794:0:21247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c436200/0x45e32cfaf74236d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf74236de expref: -99 pid: 17067 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925189.175820:0:21247:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788925189.175827:0:21247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788925189.175842:0:21247:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788925189.175875:0:21247:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788925189.175879:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788925189.175890:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788925189.175897:0:21247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788925189.175901:0:21247:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff97a6084199c0) has no exports 00000020:00080000:0.0:1788925189.175928:0:21247:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff97a6084199c0) has no exports 00010000:00010000:3.0:1788925189.181266:0:17057:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788925189.181540:0:21247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a602aed780 - data ffff97a62a554af8/ffff97a50248bc00 00000020:01000000:0.0:1788925189.181789:0:21247:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff97a501fbc360 - data ffff97a62a571af8/ffff97a502b9ac00 00100000:10000000:0.0:1788925189.189212:0:21247:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788925189.208510:0:21247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74234fb 00000020:00000080:1.0:1788925189.208522:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a50426b000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788925189.208533:0:21247:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a501f10800 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788925189.208536:0:21247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a501f10800 2 00000020:01000004:1.0:1788925189.208539:0:21247:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff97a501f10800 from lustre-OST0001 00000020:00000080:1.0:1788925189.208563:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925189.208572:0:21247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788925189.208574:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a50426c800/lustre-OST0001_UUID 00000020:00000080:1.0:1788925189.208577:0:21247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50426c800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788925189.208584:0:21247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788925189.208682:0:21247:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 925113dd-c433-4b1b-8c21-0406d9c92f6b->MGS 00010000:00010000:1.0:1788925189.208697:0:21247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf742323f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423246 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925189.208709:0:21247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf742323f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423246 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925189.208715:0:21247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788925189.208727:0:21247:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788925189.208730:0:21247:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788925189.208743:0:21247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:1.0:1788925189.208747:0:21247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf742323f lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423246 expref: -99 pid: 17802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925189.208761:0:21247:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a62d984600/0x45e32cfaf742312e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x45e32cfaf7423135 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925189.208767:0:21247:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a62d984600/0x45e32cfaf742312e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x45e32cfaf7423135 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925189.208772:0:21247:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788925189.208775:0:21247:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788925189.208776:0:21247:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788925189.208785:0:21247:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff97a502b54000 00010000:00010000:1.0:1788925189.208788:0:21247:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a62d984600/0x45e32cfaf742312e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x45e32cfaf7423135 expref: -99 pid: 17048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788925189.208804:0:21247:0:(import.c:65:import_set_state_nolock()) ffff97a502b54000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788925189.208808:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788925189.208810:0:21247:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788925189.208812:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788925189.208816:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788925189.208826:0:21247:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff97a62e35a300 x1875823470813184/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788925194 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788925189.208850:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788925189.208853:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000020:00000080:2.0:1788925189.208937:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a50426b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788925189.211935:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:925113dd-c433-4b1b-8c21-0406d9c92f6b:3620:1875823470813184:0@lo:250:kworker.0 10000000:01000000:1.0:1788925189.215849:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788925189.215868:0:21247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423119 00000020:00000080:1.0:1788925189.215880:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a634e21800/925113dd-c433-4b1b-8c21-0406d9c92f6b 00000020:01000000:1.0:1788925189.215896:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.151@tcp (flags='') 00000020:00000080:1.0:1788925189.215920:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925189.215927:0:21247:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.151@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788925189.215932:0:21247:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff97a503744d40) has no exports 10000000:01000000:1.0:1788925189.215953:0:17067:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788925189.216034:0:21247:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.151@tcp: client import never connected 00000100:00080000:1.0:1788925189.216039:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788925189.216043:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788925189.216045:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788925189.216047:0:21247:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788925189.216092:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925189.216100:0:21247:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.151@tcp (uuid 925113dd-c433-4b1b-8c21-0406d9c92f6b) 00000020:01000000:1.0:1788925189.216106:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788925189.216109:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925189.216114:0:21247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788925189.216119:0:21247:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff97a5041e7800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788925189.216124:0:21247:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff97a503b18000) has exports, disconnecting them 00000020:00080000:1.0:1788925189.216129:0:21247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff97a5041e7800), last request at 1788925109 00000020:00000080:1.0:1788925189.216132:0:21247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf7423525 00000020:00080000:1.0:1788925189.216143:0:21247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a5041e7800): rc 0 00000020:00000080:1.0:1788925189.216147:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a5041e7800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788925189.216586:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a634e21800/925113dd-c433-4b1b-8c21-0406d9c92f6b for MGC192.168.206.151@tcp 00000020:00000080:3.0:1788925189.216600:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a502b54000 for MGC192.168.206.151@tcp 00000020:00000080:3.0:1788925189.216606:0:16480:0:(genops.c:885:class_export_put()) final put ffff97a502b53800/925113dd-c433-4b1b-8c21-0406d9c92f6b 00000020:00000080:3.0:1788925189.216608:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a502b53800/925113dd-c433-4b1b-8c21-0406d9c92f6b for MGC192.168.206.151@tcp 00000020:01000000:3.0:1788925189.216612:0:16480:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.151@tcp (925113dd-c433-4b1b-8c21-0406d9c92f6b) 00000020:00000080:3.0:1788925189.217017:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e7800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788925189.223266:0:21247:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788925189.223275:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788925189.223279:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788925189.223287:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788925189.223432:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a62e207000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788925189.223480:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788925189.223489:0:21247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788925189.223495:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a503a1a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788925189.223499:0:21247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a503a1a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788925189.223504:0:21247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:3.0:1788925189.223590:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788925189.223595:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788925189.223600:0:21247:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788925189.223606:0:21247:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff97a5041e6000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788925189.223611:0:21247:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff97a503b1cd40) has exports, disconnecting them 00000020:00080000:3.0:1788925189.223616:0:21247:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff97a5041e6000), last request at 1788925109 00000020:00000080:3.0:1788925189.223620:0:21247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf742353a 00000020:00080000:3.0:1788925189.223632:0:21247:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff97a5041e6000): rc 0 00000020:00000080:3.0:1788925189.223637:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a5041e6000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1788925189.224671:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e6000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788925189.234340:0:21247:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788925189.234349:0:21247:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788925189.234353:0:21247:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788925189.234360:0:21247:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788925189.234395:0:16480:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff97a5041e0000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1788925189.234458:0:17058:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788925189.239460:0:17057:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:1.0:1788925189.242555:0:17053:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff97a6261e4200:17053] 1 exiting: rc = 0 00000100:00100000:1.0:1788925189.253539:0:17052:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff97a5038d7e00:17052] 0 exiting: rc = 1 00000100:00100000:1.0:1788925189.253692:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.253700:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.253977:0:17055:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff97a634e1c200:17055] 1 exiting: rc = 0 00000100:00100000:3.0:1788925189.254881:0:17056:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff97a634e1d400:17056] 2 exiting: rc = 0 00000100:00100000:3.0:1788925189.254957:0:20844:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff97a610cd0800:20844] 3 exiting: rc = 0 00000100:00100000:2.0:1788925189.282796:0:17054:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff97a634e1c600:17054] 0 exiting: rc = 1 00000100:00100000:1.0:1788925189.283074:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283084:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283090:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283096:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283102:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283107:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283114:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283119:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283124:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283130:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283136:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283141:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283147:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283152:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283157:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283163:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283169:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283174:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283178:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283183:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283188:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283193:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283199:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283205:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283211:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283218:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283242:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283259:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283264:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283270:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283275:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283280:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283300:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283305:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283311:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283322:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283327:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283336:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283342:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283347:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283352:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283357:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283362:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283367:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283372:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283377:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283383:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283388:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283393:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283398:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283439:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283444:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283450:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283459:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283465:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283470:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283476:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283482:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283487:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283493:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283499:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283505:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283511:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.283517:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788925189.284528:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925189.284538:0:21247:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1788925189.284543:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a5041e2800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1788925189.284555:0:21247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a5041e2800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1788925189.284561:0:21247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1788925189.284612:0:21247:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a501f10800 1 00000020:00000080:1.0:1788925189.284618:0:21247:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x45e32cfaf74234df 00000020:00000080:1.0:1788925189.284623:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a501f35800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1788925189.284633:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1788925189.284637:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925189.284641:0:21247:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788925189.284645:0:21247:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff97a60ac90000) has no exports 00000020:00000080:2.0:1788925189.286126:0:16480:0:(genops.c:844:class_export_destroy()) destroying export ffff97a501f35800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788925189.329839:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925189.329854:0:21247:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788925189.329860:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a501f10000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788925189.329865:0:21247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a501f10000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788925189.329870:0:21247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788925189.330621:0:21247:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff97a501f17000 00000020:01000000:1.0:1788925189.330645:0:21247:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788925189.330650:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788925189.330655:0:21247:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788925189.330658:0:21247:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff97a6076619c0) has no exports 00000020:00000080:1.0:1788925189.330757:0:21247:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788925189.330765:0:21247:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1788925189.330768:0:21247:0:(genops.c:885:class_export_put()) final put ffff97a604191800/OSS_uuid 00000020:00000080:1.0:1788925189.330771:0:21247:0:(genops.c:844:class_export_destroy()) destroying export ffff97a604191800/OSS_uuid for OSS 00000020:01000000:1.0:1788925189.330775:0:21247:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:1.0:1788925189.330921:0:18578:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff97a61816d800:18578] 2 exiting: rc = 0 00000100:00100000:1.0:1788925189.331002:0:18576:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff97a6261e4600:18576] 0 exiting: rc = 1 00000100:00100000:3.0:1788925189.331125:0:18952:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff97a503951a00:18952] 3 exiting: rc = 0 00000100:00100000:3.0:1788925189.331204:0:18577:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff97a5029be200:18577] 1 exiting: rc = 0 00000100:00100000:1.0:1788925189.331368:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331375:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331381:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331386:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331391:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331396:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331445:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331450:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331456:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331461:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331466:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331471:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331476:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331482:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331487:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331493:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331499:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331504:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331509:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331514:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331519:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331524:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331530:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331535:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331540:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331546:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331552:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331558:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331563:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331568:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331574:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331594:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331602:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331607:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331613:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331619:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331624:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331630:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331635:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331641:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331646:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331659:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331664:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331857:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331864:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331869:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331874:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331879:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331884:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331889:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331894:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331905:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331911:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331916:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331921:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331926:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331934:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331939:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331944:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331948:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331953:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331957:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331963:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.331968:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:0.0:1788925189.335978:0:17065:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788925189.336018:0:18580:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff97a602e49800:18580] 1 exiting: rc = 0 00000100:00100000:2.0:1788925189.336263:0:18579:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff97a602e49400:18579] 0 exiting: rc = 1 00000100:00100000:1.0:1788925189.336366:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336374:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336379:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336384:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336389:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336394:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336436:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336444:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336450:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336455:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336460:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336465:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336487:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336493:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336498:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336504:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336509:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336520:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336526:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336531:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336536:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336541:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336555:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336560:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336565:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336570:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336584:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336590:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336595:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336600:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336605:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336610:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336616:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336621:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336627:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336632:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336637:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336642:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336648:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336653:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336660:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336665:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336670:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336674:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336680:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336685:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336690:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336703:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336708:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336713:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336720:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336724:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336729:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336734:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336739:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336744:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336749:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336754:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336759:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336763:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336768:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336776:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336781:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.336786:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.341705:0:18581:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff97a602e49a00:18581] 0 exiting: rc = 1 00000100:00100000:0.0:1788925189.343590:0:18583:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff97a60765ae00:18583] 2 exiting: rc = 0 00000100:00100000:0.0:1788925189.343859:0:18582:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff97a60765b800:18582] 1 exiting: rc = 0 00000100:00100000:2.0:1788925189.345131:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345142:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345158:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345164:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345169:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345174:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345179:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345184:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345189:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345194:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345199:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345221:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345227:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345232:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345238:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345253:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345258:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345263:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345279:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345284:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345290:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345295:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345301:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345306:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345310:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345315:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345320:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345325:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345331:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345335:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345340:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345345:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345350:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345355:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345360:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345376:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345381:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345388:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345393:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345398:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345418:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.345425:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347215:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347237:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347250:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347256:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347261:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347266:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347271:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347276:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347281:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347287:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347291:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347312:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347317:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347322:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347327:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347332:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347337:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347356:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347362:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347367:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347372:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788925189.347383:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788925189.358938:0:18584:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff97a503ad3a00:18584] 0 exiting: rc = 1 00000100:00100000:2.0:1788925189.359316:0:18585:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff97a604050e00:18585] 1 exiting: rc = 0 00000100:00100000:3.0:1788925189.359474:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359482:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359487:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359503:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359507:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359513:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359518:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359523:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359528:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359533:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359538:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359543:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359548:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359553:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359562:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359568:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359581:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359588:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359594:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359599:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359604:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359609:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359616:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359620:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359625:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359629:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359634:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359638:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359643:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359648:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359654:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359659:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359663:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359668:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359674:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359679:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359684:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359689:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359702:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359707:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359713:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359717:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359722:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359727:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359732:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359736:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359741:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359746:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359751:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359757:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359762:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359767:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.359771:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360048:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360057:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360062:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360067:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360071:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360077:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360082:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360089:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360096:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360100:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.360105:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361086:0:18587:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff97a62d980200:18587] 1 exiting: rc = 0 00000100:00100000:2.0:1788925189.361219:0:18586:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff97a604051600:18586] 0 exiting: rc = 1 00000100:00100000:3.0:1788925189.361314:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361321:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361335:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361342:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361348:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361353:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361360:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361383:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361514:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361522:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361528:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361535:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361541:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361546:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361553:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361559:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361564:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361570:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361576:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361726:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361733:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361739:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361744:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361749:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361755:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361761:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361767:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361773:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361779:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361784:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361790:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361809:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361817:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361823:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361828:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361834:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361840:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361845:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361851:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361856:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361861:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361866:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361871:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361897:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361904:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361910:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361915:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361921:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361927:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361932:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361939:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361946:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361951:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361956:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361963:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361985:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361991:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.361997:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362002:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362008:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362015:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362020:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362026:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788925189.362039:0:21247:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788925189.370081:0:21247:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1788925211.815153:0:22012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788925221.983081:0:22611:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788925221.983096:0:22611:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1788925221.983098:0:22611:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788925221.983211:0:22611:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a62e331000 00000020:01000004:3.0:1788925221.983227:0:22611:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788925221.983234:0:22611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788925221.983247:0:22611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff97a60ac919c0) 00000020:00000080:3.0:1788925221.983262:0:22611:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788925222.043539:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.048347:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788925222.049194:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:0.0:1788925222.052702:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.053182:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.053461:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.053675:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.053852:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.054223:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.055777:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.056188:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.056457:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.056643:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.056848:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.057215:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.057608:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788925222.057888:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788925222.058274:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.060179:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.060623:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.060925:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.061303:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.061588:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.061809:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.062172:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.062397:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.062727:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.062920:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.063487:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.063730:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.063945:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788925222.064591:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.064823:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.070562:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.071149:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788925222.073582:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788925222.073970:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.075522:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788925222.076104:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788925222.078946:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788925222.079512:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.079850:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.080365:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788925222.083955:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.084509:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788925222.084762:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.085014:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.088856:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.090821:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.091451:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.095793:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.096097:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788925222.096527:0:22611:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:3.0:1788925222.098592:0:22611:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788925222.098807:0:22611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788925222.098816:0:22611:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788925222.098829:0:22611:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423a1f 00000020:01000004:3.0:1788925222.098838:0:22611:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788925222.098844:0:22611:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788925222.098850:0:22611:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a62e331000 from MGS 00000020:01000004:3.0:1788925222.098853:0:22611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788925222.098866:0:22611:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff97a60ac94d40) 00000020:00000080:3.0:1788925222.098879:0:22611:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788925222.098939:0:22611:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a62e331000 from MGS, refs=2 00080000:01000000:3.0:1788925222.098944:0:22611:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788925222.098950:0:22611:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423a2d 00000100:00100000:0.0:1788925222.103579:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788925222.103766:0:22611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788925222.103774:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788925222.111658:0:22611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788925222.111678:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788925222.113850:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.114036:0:22611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788925222.114043:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788925222.114718:0:22611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788925222.114724:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788925222.119442:0:22611:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788925222.119455:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788925222.120653:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.120659:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.120660:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.120984:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.120987:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.120989:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925222.121685:0:22611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788925222.130649:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788925222.132623:0:22611:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788925222.137610:0:22624:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788925222.137678:0:22611:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788925222.137743:0:22611:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788925222.139895:0:22611:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788925222.140392:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.141397:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788925222.141425:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788925222.142270:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788925222.142278:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788925222.144381:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788925222.144395:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788925222.145616:0:22611:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788925222.145639:0:22611:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.151@tcp' 00000020:01000004:0.0:1788925222.145640:0:22611:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788925222.145669:0:22611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.151@tcp (typ=mgc) 00000020:00000080:0.0:1788925222.145680:0:22611:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.151@tcp (ffff97a60841cd40) 00000020:00000080:0.0:1788925222.145697:0:22611:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788925222.145776:0:22611:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a63c0bd000@MGC192.168.206.151@tcp: add connection 192.168.206.151@tcp at head 00000100:00080000:1.0:1788925222.145942:0:22628:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1788925222.147090:0:22611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.151@tcp-0 is initialized 00000040:01000000:0.0:1788925222.147097:0:22611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788925222.151935:0:22630:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788925222.152095:0:22611:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.151@tcp (uuid 6380dc84-8626-4009-8bc6-29a71e76153e) 00000020:00000080:0.0:1788925222.152120:0:22611:0:(genops.c:1384:class_connect()) connect: client 6380dc84-8626-4009-8bc6-29a71e76153e, cookie 0x45e32cfaf7423a3b 00000100:00080000:0.0:1788925222.152134:0:22611:0:(import.c:545:import_select_connection()) MGC192.168.206.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925222.152146:0:22611:0:(import.c:666:import_select_connection()) MGC192.168.206.151@tcp: import ffff97a63c0bd000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925222.152199:0:22611:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e350e00 x1875823470813952/t0(0) o250->MGC192.168.206.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925222.152222:0:22611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 6380dc84-8626-4009-8bc6-29a71e76153e->MGS 00000020:01000004:0.0:1788925222.152248:0:22611:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788925222.152253:0:22611:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788925222.152266:0:22611:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff97a608418000) 00000020:00000080:0.0:1788925222.152278:0:22611:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788925222.156369:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6380dc84-8626-4009-8bc6-29a71e76153e:3620:1875823470813952:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788925222.156488:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.158628:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470813952 00000100:00100000:1.0:1788925222.158643:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470813952 00000100:00100000:1.0:1788925222.158686:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925222.158694:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3620:x1875823470813952:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788925222.158721:0:22625:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 6380dc84-8626-4009-8bc6-29a71e76153e@0@lo t0 exp 0000000000000000 cur 608 last 0 00000020:00000080:1.0:1788925222.158749:0:22625:0:(genops.c:1384:class_connect()) connect: client 6380dc84-8626-4009-8bc6-29a71e76153e, cookie 0x45e32cfaf7423a49 00000100:00080000:1.0:1788925222.158896:0:22625:0:(import.c:65:import_set_state_nolock()) ffff97a60773f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925222.158978:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+5:3620:x1875823470813952:12345-0@lo:250:mount.lustre.0 Request processed in 284us (2490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.158985:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925222.159056:0:3620:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788925222.159065:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.206.151@tcp: connect to target with instance 0 00000100:00080000:1.0:1788925222.159094:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.206.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788925222.159098:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788925222.159102:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a63c0bd000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788925222.159105:0:3620:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788925222.159114:0:3620:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788925222.159120:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:6380dc84-8626-4009-8bc6-29a71e76153e:3620:1875823470813952:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788925222.176192:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.176378:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788925222.176385:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788925222.181546:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788925222.181560:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788925222.184541:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788925222.184554:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788925222.185617:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.185787:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788925222.185793:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788925222.192974:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788925222.192990:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788925222.252213:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925222.252458:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788925222.252466:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788925222.254436:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788925222.254449:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788925222.255137:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.255469:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788925222.255475:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788925222.256509:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788925222.256519:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788925222.257284:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.257575:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788925222.257580:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788925222.258313:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788925222.258322:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788925222.258965:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788925222.259672:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788925222.259678:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788925222.261725:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788925222.261802:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788925222.303801:0:22611:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925222.304009:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788925222.304016:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788925222.307008:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788925222.307022:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788925222.308125:0:22611:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788925222.308142:0:22611:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788925222.312312:0:22611:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788925222.312345:0:22611:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788925222.312351:0:22611:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788925222.312500:0:22611:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788925222.312535:0:22611:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788925222.312540:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788925222.312542:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788925222.312543:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925222.312544:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925222.312545:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925222.312546:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925222.312547:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925222.312549:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788925222.312551:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925222.312552:0:22611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925222.312555:0:22611:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788925222.312556:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788925222.312558:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788925222.312559:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925222.312560:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925222.312560:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925222.312562:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925222.312563:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925222.312563:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788925222.312565:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925222.312566:0:22611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925222.312599:0:22611:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788925222.312618:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814080:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788925222.312684:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925222.312720:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6056b9900 going to sleep for 11 seconds 00000100:00100000:3.0:1788925222.314383:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814080 00000100:00100000:3.0:1788925222.314398:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814080 00000100:00100000:3.0:1788925222.314464:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925222.314474:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+5:22611:x1875823470814080:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788925222.314534:0:22627:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788925222.314538:0:22627:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788925222.314542:0:22627:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788925222.314949:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788925222.315598:0:22627:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788925222.317644:0:22649:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788925222.317653:0:22649:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788925222.317656:0:22649:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788925222.317658:0:22649:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788925222.317834:0:22649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788925222.318041:0:22627:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788925222.318053:0:22627:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788925222.323168:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+5:22611:x1875823470814080:12345-0@lo:253:mount.lustre.0 Request processed in 8686us (10474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.323183:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788925222.323315:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814080:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788925222.323332:0:22611:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788925222.323335:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788925222.323337:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788925222.323338:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925222.323339:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925222.323340:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925222.323341:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925222.323343:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925222.323344:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788925222.323346:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925222.323347:0:22611:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788925222.323368:0:22611:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a62e331000 from lustre-MDT0000 10000000:01000000:0.0:1788925222.323398:0:22611:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788925222.323428:0:22611:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788925222.323432:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97a60841cd40 10000000:01000000:0.0:1788925222.323439:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925222.323447:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97a60841cd40 from 1 10000000:01000000:0.0:1788925222.323451:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788925222.323489:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.323501:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.323510:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925222.323530:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814208:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925222.323567:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925222.323611:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6056b9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.323779:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814208 00000100:00100000:1.0:1788925222.323786:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814208 00000100:00100000:1.0:1788925222.323836:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925222.323846:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+5:22611:x1875823470814208:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925222.323859:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925222.323872:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c436200/0x45e32cfaf7423a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423a50 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925222.323896:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c436200/0x45e32cfaf7423a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423a50 expref: 6 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925222.323907:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c436200/0x45e32cfaf7423a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423a50 expref: 6 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925222.323916:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c436200, rc 0) 00000100:00100000:1.0:1788925222.323953:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+6:22611:x1875823470814208:12345-0@lo:101:mount.lustre.0 Request processed in 110us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.323960:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925222.324185:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814208:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925222.324199:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.324208:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.324284:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814336:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925222.324313:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.324344:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.324391:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814336 00000100:00100000:0.0:1788925222.324396:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814336 00000100:00100000:0.0:1788925222.324449:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788925222.324455:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+6:22611:x1875823470814336:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925222.324531:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+6:22611:x1875823470814336:12345-0@lo:501:mount.lustre.0 Request processed in 76us (217us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925222.324538:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925222.324883:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814336:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788925222.324915:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788925222.324937:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.324947:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925222.324955:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a62e331000 10000000:01000000:3.0:1788925222.324960:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788925222.324964:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a62e331000 10000000:01000000:3.0:1788925222.324967:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788925222.324971:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a62e331000 from 1 10000000:01000000:3.0:1788925222.324973:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788925222.324995:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.325002:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.325009:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.325020:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814464:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925222.325161:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.325190:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.325237:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814464 00000100:00100000:0.0:1788925222.325242:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814464 00000100:00100000:0.0:1788925222.325276:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925222.325284:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+6:22611:x1875823470814464:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925222.325292:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925222.325303:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858c200/0x45e32cfaf7423a65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423a5e expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.325319:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858c200/0x45e32cfaf7423a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423a5e expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.325328:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858c200/0x45e32cfaf7423a65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423a5e expref: 7 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.325335:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858c200, rc 0) 00000100:00100000:0.0:1788925222.325377:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+7:22611:x1875823470814464:12345-0@lo:101:mount.lustre.0 Request processed in 94us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.325383:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925222.325430:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925222.325443:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a65 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.325451:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423a65 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925222.325464:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788925222.325483:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a65 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.325490:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f06600/0x45e32cfaf7423a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a65 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925222.325496:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788925222.325500:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788925222.325505:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a62e331000 10000000:01000000:2.0:1788925222.325507:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788925222.325510:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788925222.325519:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788925222.325536:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.325543:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.325550:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925222.325562:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788925222.325591:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.325627:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618523780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925222.326198:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814592 00000100:00100000:3.0:1788925222.326206:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814592 00000100:00100000:3.0:1788925222.326246:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788925222.326254:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+7:22611:x1875823470814592:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925222.326265:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925222.326278:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f07e00/0x45e32cfaf7423a73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423a6c expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.326294:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f07e00/0x45e32cfaf7423a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423a6c expref: 8 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.326302:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f07e00/0x45e32cfaf7423a73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423a6c expref: 8 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.326309:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f07e00, rc 0) 00000100:00100000:3.0:1788925222.326355:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+8:22611:x1875823470814592:12345-0@lo:101:mount.lustre.0 Request processed in 101us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.326361:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925222.326438:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925222.326451:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a73 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.326459:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423a73 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925222.326530:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925222.326560:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.326594:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618523780 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.327173:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814720 00000100:00100000:1.0:1788925222.327179:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814720 00000100:00100000:1.0:1788925222.327219:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925222.327227:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+8:22611:x1875823470814720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925222.327380:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+9:22611:x1875823470814720:12345-0@lo:501:mount.lustre.0 Request processed in 153us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.327395:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925222.327423:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925222.327453:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925222.327495:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.327517:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618523780 going to sleep for 11 seconds 00000100:00100000:2.0:1788925222.327534:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814848 00000100:00100000:2.0:1788925222.327545:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814848 00000100:00100000:2.0:1788925222.327566:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925222.327572:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+9:22611:x1875823470814848:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925222.328644:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+9:22611:x1875823470814848:12345-0@lo:503:mount.lustre.0 Request processed in 1067us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.328654:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925222.328665:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470814848:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788925222.330281:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22650:1875823470814976:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925222.330349:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.330393:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6358396c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.330558:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470814976 00000100:00100000:0.0:1788925222.330565:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470814976 00000100:00100000:0.0:1788925222.330604:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925222.330612:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+9:22650:x1875823470814976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925222.331386:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+9:22650:x1875823470814976:12345-0@lo:502:llog_process_th.0 Request processed in 773us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.331431:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788925222.332198:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22650:1875823470814976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925222.332234:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.332246:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.332248:0:22650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788925222.332253:0:22650:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788925222.332256:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925222.332272:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff97a503b199c0) 00000020:00000080:2.0:1788925222.332295:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788925222.332300:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788925222.332388:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788925222.332394:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423a81 00000020:00000080:2.0:1788925222.332598:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788925222.332846:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925222.332850:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.332851:0:22650:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788925222.332854:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.332858:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.332860:0:22650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788925222.332863:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925222.332872:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff97a503b1cd40) 00000020:00000080:2.0:1788925222.332883:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788925222.332887:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788925222.332889:0:22650:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788925222.332892:0:22650:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788925222.332904:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788925222.332947:0:22650:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a62e331000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788925222.332960:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff97a503b18000) 00000020:00000080:2.0:1788925222.332968:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788925222.333023:0:22650:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788925222.333028:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423a96 00000020:00000080:2.0:1788925222.333127:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788925222.333133:0:22650:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788925222.333138:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x45e32cfaf7423a9d 00080000:01000000:2.0:1788925222.333142:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788925222.333145:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423aa4 00010000:00010000:0.0:1788925222.444813:0:22650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788925222.445691:0:22650:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934637 00000001:00080000:0.0:1788925222.446138:0:22650:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788925222.446661:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff97a60841b380) 00000020:00000080:0.0:1788925222.446680:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788925222.446749:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788925222.446757:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423ab2 00000020:00000080:0.0:1788925222.451716:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788925222.453891:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x45e32cfaf7423ab9 00000020:00000080:0.0:1788925222.455063:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788925222.455085:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925222.455092:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.455094:0:22650:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788925222.455097:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788925222.455100:0:22650:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:0.0:1788925222.455102:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788925222.455103:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788925222.455105:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788925222.455107:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.455109:0:22650:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788925222.455112:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925222.455116:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.455118:0:22650:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788925222.455122:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788925222.455366:0:22650:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788925222.455388:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925222.455392:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.455393:0:22650:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788925222.455396:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925222.455431:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.455433:0:22650:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788925222.455448:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788925222.455454:0:22650:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:0.0:1788925222.455479:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788925222.455494:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff97a6084199c0) 00000020:00000080:0.0:1788925222.455510:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788925222.455517:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788925222.455588:0:22650:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788925222.455594:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788925222.455601:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423ac7 00010000:00080000:0.0:1788925222.455633:0:22650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a610e87800@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1788925222.459140:0:22650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:0.0:1788925222.461065:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788925222.461089:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:0.0:1788925222.461121:0:22650:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788925222.461140:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423ace 00000100:00080000:0.0:1788925222.461152:0:22650:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925222.461234:0:22650:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97a610e87800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925222.461269:0:22650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e352a00 x1875823470815104/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925222.461340:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788925222.461427:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788925222.461524:0:22650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:0.0:1788925222.461597:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925222.461601:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.461602:0:22650:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:0.0:1788925222.461605:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788925222.461608:0:22650:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:0.0:1788925222.461610:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788925222.461612:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788925222.461613:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788925222.461616:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.461617:0:22650:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788925222.461620:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788925222.461630:0:22650:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788925222.461633:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.461635:0:22650:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788925222.461637:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788925222.461642:0:22650:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:0.0:1788925222.461660:0:22650:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788925222.461663:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788925222.461676:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff97a6076619c0) 00000020:00000080:0.0:1788925222.461687:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:0.0:1788925222.461692:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788925222.461756:0:22650:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1788925222.461762:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788925222.461768:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423adc 00010000:00080000:0.0:1788925222.461793:0:22650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a610e8a000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1788925222.461976:0:22650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:2.0:1788925222.462326:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470815104 00000100:00100000:2.0:1788925222.462335:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470815104 00000100:00100000:2.0:1788925222.462367:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925222.462374:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1875823470815104:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788925222.462390:0:22637:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:0.0:1788925222.468708:0:22650:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788925222.469005:0:22650:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788925222.473175:0:22650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925222.473453:0:22650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000100:00100000:3.0:1788925222.477715:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3620:x1875823470815104:12345-0@lo:38:llog_process_th.0 Request processed in 15331us (16279us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925222.477732:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788925222.477826:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925222.477831:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925222.477835:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815104:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788925222.479009:0:22650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:3.0:1788925222.479394:0:22656:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788925222.479468:0:22656:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788925222.480078:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788925222.480090:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788925222.480126:0:22650:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788925222.480146:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423ae3 00000100:00080000:1.0:1788925222.480231:0:22650:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925222.480243:0:22650:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a610e8a000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925222.480276:0:22650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b0700 x1875823470815232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925222.480340:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815232:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788925222.480385:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470815232 offset 0 length 520: 4 00000100:00080000:1.0:1788925222.480485:0:22650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788925222.480551:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925222.480556:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.480558:0:22650:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788925222.480561:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788925222.480563:0:22650:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:1.0:1788925222.480565:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925222.480567:0:22650:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925222.480568:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788925222.480570:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.480572:0:22650:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788925222.480580:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788925222.480585:0:22650:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788925222.480588:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.480590:0:22650:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788925222.480593:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788925222.480596:0:22650:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1788925222.480618:0:22650:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788925222.480621:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788925222.480633:0:22650:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff97a6359999c0) 00000020:00000080:1.0:1788925222.480645:0:22650:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:1.0:1788925222.480650:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788925222.480706:0:22650:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788925222.480712:0:22650:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:1.0:1788925222.480718:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x45e32cfaf7423af1 00010000:00080000:1.0:1788925222.480745:0:22650:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a5039bb000@lustre-OST0001-osc-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1788925222.480946:0:22650:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788925222.481008:0:22650:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788925222.481023:0:22650:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788925222.483229:0:22650:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925222.483838:0:22650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788925222.483995:0:22650:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:2.0:1788925222.484729:0:22658:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788925222.484893:0:22658:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788925222.485830:0:22650:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788925222.485842:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788925222.485880:0:22650:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788925222.485901:0:22650:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423af8 00000100:00080000:1.0:1788925222.485911:0:22650:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925222.485922:0:22650:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925222.485956:0:22650:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b3800 x1875823470815360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925222.485983:0:22650:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1788925222.486094:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815360:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788925222.486148:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470815360 offset 0 length 520: 4 00000020:01000000:1.0:1788925222.486270:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925222.486275:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.486277:0:22650:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788925222.486280:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925222.486283:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.486284:0:22650:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788925222.486287:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788925222.486289:0:22650:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788925222.486292:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925222.486294:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.486295:0:22650:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788925222.486297:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925222.486299:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.486300:0:22650:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788925222.486378:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788925222.486441:0:22650:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22650:1875823470815488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925222.486497:0:22650:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.486522:0:22650:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a501085780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925222.486576:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470815488 00000100:00100000:3.0:1788925222.486583:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470815488 00000100:00100000:3.0:1788925222.486629:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925222.486638:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+9:22650:x1875823470815488:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788925222.486830:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+9:22650:x1875823470815488:12345-0@lo:502:llog_process_th.0 Request processed in 192us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.486837:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925222.486928:0:22650:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22650:1875823470815488:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788925222.486954:0:22650:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925222.486958:0:22650:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925222.486959:0:22650:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788925222.486962:0:22650:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788925222.487276:0:22611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788925222.487300:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788925222.487397:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a73 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487438:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166da00/0x45e32cfaf7423a6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a73 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925222.487446:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a62e331000 from 1 10000000:01000000:3.0:1788925222.487449:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788925222.487477:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487485:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487506:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.487521:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815616:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925222.487555:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.487575:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff840 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.487698:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470815616 00000100:00100000:1.0:1788925222.487704:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470815616 00000100:00100000:3.0:1788925222.487860:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925222.487869:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+9:22611:x1875823470815616:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925222.487880:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925222.487892:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423aff expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487912:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 10 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487922:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 10 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.487932:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f06c00, rc 0) 00000100:00100000:3.0:1788925222.487982:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+10:22611:x1875823470815616:12345-0@lo:101:mount.lustre.0 Request processed in 113us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.487988:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925222.488108:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815616:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925222.488121:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.488131:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925222.489145:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815744:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788925222.489279:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.489440:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.489515:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470815744 00000100:00100000:1.0:1788925222.489522:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470815744 00000100:00100000:1.0:1788925222.489642:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925222.489652:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+10:22611:x1875823470815744:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788925222.489669:0:22627:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788925222.489675:0:22627:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788925222.489769:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+10:22611:x1875823470815744:12345-0@lo:256:mount.lustre.0 Request processed in 118us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.489776:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925222.489846:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815744:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788925222.490518:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925222.490547:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.490558:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925222.490565:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a62e331000 from 1 10000000:01000000:2.0:1788925222.490568:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925222.490598:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.490606:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.490616:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925222.490633:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788925222.490673:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.491463:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925222.491579:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470815872 00000100:00100000:3.0:1788925222.491587:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470815872 00000100:00100000:0.0:1788925222.491655:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925222.491666:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+10:22611:x1875823470815872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925222.491679:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925222.491695:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b0d expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.491719:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 11 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.491742:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 11 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.491768:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858c400, rc 0) 00000100:00100000:0.0:1788925222.491820:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470815872:12345-0@lo:101:mount.lustre.0 Request processed in 156us (1146us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.491827:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788925222.491983:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470815872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925222.492000:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.492010:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925222.492086:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925222.492122:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.492150:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.492267:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816000 00000100:00100000:0.0:1788925222.492271:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816000 00000100:00100000:0.0:1788925222.492293:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925222.492299:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470816000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925222.492454:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470816000:12345-0@lo:501:mount.lustre.0 Request processed in 155us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.492461:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925222.492601:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925222.492629:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925222.492667:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.492691:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.492811:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816128 00000100:00100000:0.0:1788925222.492816:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816128 00000100:00100000:0.0:1788925222.492834:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925222.492840:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470816128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925222.492921:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470816128:12345-0@lo:503:mount.lustre.0 Request processed in 80us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.492928:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788925222.493007:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925222.493842:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22660:1875823470816256:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925222.493890:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.493955:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe4000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.493992:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816256 00000100:00100000:1.0:1788925222.493998:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816256 00000100:00100000:1.0:1788925222.494086:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788925222.494096:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+11:22660:x1875823470816256:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925222.495075:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+11:22660:x1875823470816256:12345-0@lo:502:llog_process_th.0 Request processed in 967us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925222.495085:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788925222.495198:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22660:1875823470816256:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788925222.495227:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.495235:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495238:0:22660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788925222.495244:0:22660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a62e331000 00000020:00000080:2.0:1788925222.495247:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925222.495254:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925222.495257:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495258:0:22660:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788925222.495260:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.495263:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495264:0:22660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788925222.495267:0:22660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a62e331000 00000020:00000080:2.0:1788925222.495269:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925222.495327:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925222.495330:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495331:0:22660:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788925222.495333:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.495344:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495345:0:22660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788925222.495349:0:22660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a62e331000 00000020:00000080:2.0:1788925222.495351:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925222.495371:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925222.495374:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495375:0:22660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788925222.495378:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925222.495380:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925222.495381:0:22660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788925222.495385:0:22660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a62e331000 00000020:00000080:2.0:1788925222.495386:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788925222.495449:0:22660:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22660:1875823470816384:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925222.495489:0:22660:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.495522:0:22660:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe4000 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.498619:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816384 00000100:00100000:0.0:1788925222.498631:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816384 00000100:00100000:0.0:1788925222.498681:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925222.498691:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22660:x1875823470816384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925222.498923:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22660:x1875823470816384:12345-0@lo:502:llog_process_th.0 Request processed in 233us (3433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.498932:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925222.499003:0:22660:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22660:1875823470816384:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788925222.499034:0:22660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925222.499041:0:22660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925222.499044:0:22660:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788925222.499049:0:22660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788925222.499127:0:22611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788925222.499149:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788925222.499164:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.499179:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925222.499231:0:22611:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788925222.499234:0:22611:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a62e331000 10000000:01000000:3.0:1788925222.499237:0:22611:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a62e331000 10000000:01000000:3.0:1788925222.499241:0:22611:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788925222.499246:0:22611:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a62e331000 from 1 10000000:01000000:3.0:1788925222.499249:0:22611:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925222.499278:0:22611:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.499286:0:22611:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.499294:0:22611:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.499396:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816512:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925222.499468:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.499498:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.499507:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816512 00000100:00100000:0.0:1788925222.499512:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816512 00000100:00100000:0.0:1788925222.499583:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925222.499591:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+11:22611:x1875823470816512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925222.499601:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925222.499613:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858dc00/0x45e32cfaf7423b22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b1b expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.499634:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858dc00/0x45e32cfaf7423b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b1b expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.499645:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858dc00/0x45e32cfaf7423b22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b1b expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925222.499653:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858dc00, rc 0) 00000100:00100000:0.0:1788925222.499691:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470816512:12345-0@lo:101:mount.lustre.0 Request processed in 101us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.499696:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816512:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925222.499698:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:3.0:1788925222.499708:0:22611:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b22 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.499717:0:22611:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b22 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.499854:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925222.499881:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.501697:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925222.504996:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816640 00000100:00100000:2.0:1788925222.505011:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816640 00000100:00100000:2.0:1788925222.505062:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925222.505101:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470816640:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925222.512080:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470816640:12345-0@lo:501:mount.lustre.0 Request processed in 6962us (12178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.512093:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925222.512879:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925222.512933:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925222.512983:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.513292:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a610eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925222.513464:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816768 00000100:00100000:0.0:1788925222.513472:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816768 00000100:00100000:0.0:1788925222.513610:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925222.513619:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470816768:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925222.513734:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470816768:12345-0@lo:503:mount.lustre.0 Request processed in 116us (751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.513747:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925222.513820:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470816768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925222.515253:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470816896:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925222.515316:0:22666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.515348:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470816896 00000100:00100000:2.0:1788925222.515353:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470816896 00000100:00100000:2.0:1788925222.515479:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925222.515487:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470816896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925222.515588:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470816896:12345-0@lo:502:llog_process_th.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.515601:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925222.517462:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502980d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925222.517501:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470816896:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788925222.518064:0:22666:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788925222.518096:0:22666:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff97a60ac90000) 00000020:00000080:3.0:1788925222.518119:0:22666:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788925222.518301:0:22666:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a62e331000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788925222.518381:0:22666:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a62e331000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788925222.518384:0:22666:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a62e331000 4 00010000:00080000:3.0:1788925222.518439:0:22666:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a503ad8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1788925222.521125:0:22666:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788925222.521471:0:22666:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788925222.521514:0:22666:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788925222.521528:0:22666:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x45e32cfaf7423b30 00000100:00080000:3.0:1788925222.521538:0:22666:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925222.521551:0:22666:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a503ad8800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925222.521585:0:22666:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e359880 x1875823470817024/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925222.521627:0:22666:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788925222.523062:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470817024:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788925222.523141:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.523364:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470817152:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788925222.523440:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817024 00000100:00100000:1.0:1788925222.523448:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817024 00000100:00100000:1.0:1788925222.523477:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925222.523478:0:22666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925222.523484:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470817024:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788925222.523498:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6184fd240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925222.523544:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3620:x1875823470817024:12345-0@lo:38:llog_process_th.0 Request processed in 59us (402us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788925222.523551:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925222.523641:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925222.523649:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a503ad8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925222.523652:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788925222.523655:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470817024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788925222.524467:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817152 00000100:00100000:0.0:1788925222.524475:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817152 00000100:00100000:0.0:1788925222.524520:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925222.524529:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470817152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925222.524656:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470817152:12345-0@lo:502:llog_process_th.0 Request processed in 129us (1176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925222.524663:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925222.524708:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470817152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925222.525505:0:22666:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470817280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788925222.525552:0:22666:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925222.525587:0:22666:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a340e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925222.525686:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817280 00000100:00100000:2.0:1788925222.525692:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817280 00000100:00100000:2.0:1788925222.525728:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788925222.525736:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470817280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788925222.526573:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22666:x1875823470817280:12345-0@lo:502:llog_process_th.0 Request processed in 833us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.526584:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788925222.526700:0:22666:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:6380dc84-8626-4009-8bc6-29a71e76153e:22666:1875823470817280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788925222.526730:0:22666:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788925222.526832:0:22611:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788925222.526856:0:22611:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788925222.526879:0:22611:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b22 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.526891:0:22611:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f07a00/0x45e32cfaf7423b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b22 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788925222.526936:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788925222.526939:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925222.526940:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925222.526942:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925222.526943:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925222.526944:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925222.526945:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925222.526947:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925222.526948:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925222.526949:0:22611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925222.526953:0:22611:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788925222.526955:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925222.526957:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925222.526957:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925222.526963:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925222.526964:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925222.526965:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925222.526966:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925222.526967:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925222.526968:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925222.526969:0:22611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788925222.526986:0:22611:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788925222.526999:0:22611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470817408:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788925222.527038:0:22611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.527083:0:22611:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6184fdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925222.527100:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817408 00000100:00100000:2.0:1788925222.527106:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817408 00000100:00100000:2.0:1788925222.527138:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925222.527145:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470817408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788925222.527165:0:22625:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788925222.527177:0:22625:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788925222.529008:0:22625:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788925222.529026:0:22625:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788925222.529094:0:22648:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788925222.529099:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788925222.529118:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.529135:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.529143:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.529184:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.529199:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.529211:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470817536:0@lo:104: 00000100:00100000:3.0:1788925222.529263:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925222.529303:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6184fd6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925222.529356:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817536 00000100:00100000:2.0:1788925222.529363:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817536 00000100:00100000:2.0:1788925222.529430:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925222.529455:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470817536:12345-0@lo:104: 00010000:00010000:2.0:1788925222.529468:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529525:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788925222.529530:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470817536:12345-0@lo:104: Request processed in 94us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.529541:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788925222.529561:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925222.529566:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529574:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06e00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:2.0:1788925222.529578:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529587:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788925222.529593:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925222.529599:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788925222.529623:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529629:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788925222.529651:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529657:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a501f06e00/0x45e32cfaf7423aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b06 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.529672:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.529674:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925222.529676:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925222.529687:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470817664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925222.529716:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925222.529725:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:22611:x1875823470817408:12345-0@lo:253:mount.lustre.0 Request processed in 2581us (2687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925222.529738:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788925222.529860:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470817536:0@lo:104: 00010000:00010000:3.0:1788925222.529879:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.529916:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817664 00000100:00100000:3.0:1788925222.529920:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817664 00010000:00010000:3.0:1788925222.529937:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.529969:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925222.529976:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+12:3624:x1875823470817664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925222.529985:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925222.529990:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530000:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530012:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423aff expref: 12 pid: 22625 timeout: 708 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530024:0:22618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530031:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788925222.530043:0:22618:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000944736s 00010000:00010000:3.0:1788925222.530047:0:22618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530054:0:22618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530081:0:22618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530087:0:22618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530091:0:22618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925222.530095:0:22618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530102:0:22618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530120:0:22618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925222.530130:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925222.530240:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470817664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925222.530308:0:22648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.530316:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925222.530323:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f07600/0x45e32cfaf7423b37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925222.530381:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+11:3624:x1875823470817664:12345-0@lo:103:ldlm_bl.0 Request processed in 182us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925222.530389:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925222.530435:0:22611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:22611:1875823470817408:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788925222.530446:0:22611:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788925222.530449:0:22611:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788925222.530451:0:22611:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788925222.530453:0:22611:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925222.530454:0:22611:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925222.530455:0:22611:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925222.530456:0:22611:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925222.530457:0:22611:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788925222.530459:0:22611:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788925222.530460:0:22611:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925222.530467:0:22611:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788925222.530478:0:22611:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788925222.553248:0:22611:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967531 00000040:01000000:0.0:1788925222.553573:0:22611:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788925222.553665:0:22671:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967531 00000020:00080000:1.0:1788925222.553669:0:22671:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967531 00000040:01000000:1.0:1788925222.553804:0:22672:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788925222.554026:0:22611:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:01000000:0.0:1788925222.554603:0:22611:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788925222.554638:0:22611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925222.555081:0:22672:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788925222.556603:0:22611:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788925222.556621:0:22611:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788925222.556703:0:22611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788925222.557567:0:22673:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff97a62e359880 x1875823470817792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925222.557581:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000040:00080000:0.0:1788925222.560717:0:22611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788925222.563886:0:22611:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788925222.563966:0:22611:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788925222.564235:0:22672:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788925222.564287:0:22672:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788925222.565165:0:22611:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788925222.565937:0:22611:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788925222.568014:0:22611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788925222.570836:0:22611:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788925222.570874:0:22611:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb64541507988 00100000:10000000:0.0:1788925222.570883:0:22611:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788925222.572145:0:22611:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788925222.572176:0:22611:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788925222.572201:0:22611:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788925222.572218:0:22611:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788925222.577174:0:22611:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788925222.577632:0:22611:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788925223.148539:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925223.535480:0:22665:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788925223.535491:0:22665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788925223.537179:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788925223.537190:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788925223.595550:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 10000000:01000000:2.0:1788925223.851218:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788925223.851226:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a62e331000 from 11 10000000:01000000:2.0:1788925223.851231:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788925223.851282:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.851294:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925223.851305:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925223.851331:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470817920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925223.851431:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925223.851465:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618229480 going to sleep for 11 seconds 00000100:00100000:0.0:1788925223.852018:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817920 00000100:00100000:0.0:1788925223.852027:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817920 00000100:00100000:0.0:1788925223.852098:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925223.852107:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+11:22630:x1875823470817920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925223.852120:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925223.852135:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b3e expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.852176:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 12 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.852188:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 12 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925223.852197:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858cc00, rc 0) 00000100:00100000:0.0:1788925223.852550:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:22630:x1875823470817920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 443us (1147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925223.852575:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925223.852972:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470817920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925223.852992:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.853002:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925223.853074:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470818048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788925223.853118:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925223.853371:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925223.853435:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818048 00000100:00100000:2.0:1788925223.853442:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818048 00000100:00100000:2.0:1788925223.853591:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788925223.853601:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:22630:x1875823470818048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788925223.853637:0:22625:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788925223.853653:0:22625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788925223.853656:0:22625:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788925223.853749:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:22630:x1875823470818048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925223.853756:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788925223.853832:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470818048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788925223.853879:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788925223.853887:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925223.853897:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925224.178106:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925224.555192:0:22665:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788925224.555200:0:22665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788925224.555338:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788925224.555383:0:22665:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788925224.555683:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788925224.618476:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925225.194651:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925225.642706:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:2.0:1788925226.218623:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925226.666597:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925227.242988:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788925227.601264:0:22915:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788925227.691346:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788925227.691353:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788925227.691357:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925227.691364:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1788925227.691370:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788925227.691379:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97a610e87800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925227.691397:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b3480 x1875823470818304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925227.691425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925227.691429:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925227.691432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925227.691435:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925227.691437:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788925227.691440:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788925227.691442:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a503ad8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925227.691445:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff97a503ad8800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925227.691454:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b0000 x1875823470818432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925227.691494:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925227.691504:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470818176:0@lo:400:kworker.0 00000100:00100000:1.0:1788925227.691559:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925227.691653:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818304:0@lo:38:kworker.0 00000100:00100000:1.0:1788925227.691702:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925227.691719:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470818432:0@lo:38:kworker.0 00000100:00100000:1.0:1788925227.691756:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925227.691798:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818176 00000100:00100000:1.0:1788925227.691806:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818176 00000100:00100000:3.0:1788925227.691973:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818304 00000100:00100000:3.0:1788925227.691982:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818304 00000100:00100000:3.0:1788925227.692000:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925227.692006:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875823470818304:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788925227.692022:0:22638:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925227.692072:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875823470818304:12345-0@lo:38:kworker.0 Request processed in 64us (368us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925227.692078:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925227.692096:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000100:00080000:3.0:1788925227.692120:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925227.692124:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788925227.692127:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818304:0@lo:38:kworker.0 00000100:00100000:0.0:1788925227.697497:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818432 00000100:00100000:0.0:1788925227.697509:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818432 00000100:00100000:0.0:1788925227.697589:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788925227.697597:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875823470818432:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788925227.697621:0:22634:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 613 last 0 00000020:00000080:0.0:1788925227.697653:0:22634:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x45e32cfaf7423b4c 00000004:00100000:0.0:1788925227.697667:0:22634:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788925227.697793:0:22634:0:(import.c:65:import_set_state_nolock()) ffff97a63cdd4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925227.697864:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3620:x1875823470818432:12345-0@lo:38:kworker.0 Request processed in 267us (6106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925227.697870:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925227.697948:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a5039b0000 x1875823470818432/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788925227.697963:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1788925227.697970:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788925227.697974:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788925227.697976:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a503ad8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788925227.697981:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3620:1875823470818432:0@lo:38:kworker.0 00000100:00100000:1.0:1788925227.699910:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925227.699929:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:3622:x1875823470818176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925227.700005:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+12:3622:x1875823470818176:12345-0@lo:400:kworker.0 Request processed in 86us (8446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925227.700012:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925227.700512:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470818176:0@lo:400:kworker.0 00010000:00010000:2.0:1788925228.267556:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788925228.576812:0:22967:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788925228.577017:0:22967:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788925228.715752:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925229.290737:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788925229.535264:0:23018:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788925229.536734:0:23018:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788925229.738533:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:3.0:1788925230.316149:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925230.763712:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925231.338552:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925231.786727:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:3.0:1788925232.365896:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788925232.814990:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788925232.814998:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788925232.815001:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925232.815009:0:16480:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 613 00000100:00080000:1.0:1788925232.815025:0:16480:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788925232.815037:0:16480:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97a610e87800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925232.815062:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b3100 x1875823470818688/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925232.815982:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000100:00100000:0.0:1788925232.816459:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470818560:0@lo:400:kworker.0 00000100:00100000:0.0:1788925232.816531:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925232.816638:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818560 00000100:00100000:0.0:1788925232.816645:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818560 00000100:00100000:0.0:1788925232.816700:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925232.816708:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:3622:x1875823470818560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925232.816775:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:3622:x1875823470818560:12345-0@lo:400:kworker.0 Request processed in 67us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925232.816794:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925232.816841:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470818560:0@lo:400:kworker.0 00000100:00100000:2.0:1788925232.818931:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925222/real 1788925222] req@ffff97a5039b3800 x1875823470815360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925232 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788925232.820206:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925232.820213:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925232.820226:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925232.820228:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925232.820292:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470818816:0@lo:400:kworker.0 00000100:00100000:1.0:1788925232.820350:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925232.820420:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818816 00000100:00100000:1.0:1788925232.820428:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818816 00000100:00100000:1.0:1788925232.820465:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925232.820473:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470818816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925232.820516:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470818816:12345-0@lo:400:kworker.0 Request processed in 43us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925232.820522:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925232.820557:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a5039b2680 x1875823470818816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925232.820570:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470818816:0@lo:400:kworker.0 00000100:00100000:2.0:1788925232.823731:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b3800 x1875823470815360/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925232 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925232.823822:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925222/real 1788925222] req@ffff97a5039b0700 x1875823470815232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925232 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925232.823844:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b0700 x1875823470815232/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925232 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925232.823866:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818688:0@lo:38:kworker.0 00000100:00100000:2.0:1788925232.823967:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925232.824063:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788925232.824090:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788925232.824094:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815360:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788925232.824118:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788925232.824125:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788925232.824130:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470815232:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788925232.825087:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925232.825094:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788925232.825097:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925232.825102:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1788925232.825108:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788925232.825118:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a610e8a000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925232.825147:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b2680 x1875823470818944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925232.825167:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925232.825170:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788925232.825179:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925232.825182:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 608 00000100:00080000:1.0:1788925232.825185:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788925232.825190:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925232.825202:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b0e00 x1875823470819072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925232.825872:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818944:0@lo:8:kworker.0 00000400:00000100:2.0:1788925232.825925:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470818944 offset 0 length 520: 4 00000100:00100000:2.0:1788925232.825954:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470819072:0@lo:8:kworker.0 00000400:00000100:2.0:1788925232.825973:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470819072 offset 0 length 520: 4 00000100:00100000:3.0:1788925232.826862:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470818688 00000100:00100000:3.0:1788925232.826872:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470818688 00000100:00100000:3.0:1788925232.826914:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925232.826921:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875823470818688:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788925232.826939:0:22638:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925232.827009:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875823470818688:12345-0@lo:38:kworker.0 Request processed in 86us (3041us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925232.827029:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788925232.827111:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925232.827116:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925232.827119:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818688:0@lo:38:kworker.0 00010000:00010000:1.0:1788925233.399642:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925233.834947:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:3.0:1788925234.412095:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925234.802252:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788925234.862677:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925235.434567:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925235.883186:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:2.0:1788925236.461669:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788925236.544453:0:23363:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788925236.544456:0:23363:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788925236.544458:0:23363:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:0.0:1788925236.544566:0:23363:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a503ad9800 00000020:01000004:0.0:1788925236.544581:0:23363:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:0.0:1788925236.544593:0:23363:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788925236.544607:0:23363:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff97a607664d40) 00000020:00000080:0.0:1788925236.544623:0:23363:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788925236.652292:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.653615:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788925236.654323:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.655127:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.655630:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.656204:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.656849:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.657626:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.658001:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.658983:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.660116:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788925236.660643:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.661198:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.661685:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788925236.667375:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.670488:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.671362:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.672203:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.672616:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.673194:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.673634:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.674101:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.674373:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.674757:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.675230:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.675613:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.675824:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.676260:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.676682:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.677144:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.677576:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.677872:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.678301:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.678642:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.678889:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.679324:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.679830:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.680249:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.680611:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.680927:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.681578:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.681975:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.682462:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.683138:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:3.0:1788925236.683497:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788925236.683842:0:23363:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00080000:01000000:3.0:1788925236.685802:0:23363:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788925236.686036:0:23363:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1788925236.686053:0:23363:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788925236.686065:0:23363:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423b5a 00000020:01000004:3.0:1788925236.686072:0:23363:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788925236.686103:0:23363:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788925236.686107:0:23363:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788925236.686113:0:23363:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1788925236.686140:0:23363:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1788925236.686144:0:23363:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:0.0:1788925236.690232:0:23363:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788925236.690271:0:23363:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20001 00000020:01000004:0.0:1788925236.690276:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788925236.690277:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788925236.690279:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925236.690280:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925236.690281:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925236.690282:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925236.690284:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925236.690285:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925236.690287:0:23363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925236.690290:0:23363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:0.0:1788925236.690292:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788925236.690293:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788925236.690295:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925236.690296:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925236.690297:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925236.690298:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925236.690299:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788925236.690300:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925236.690301:0:23363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925236.690324:0:23363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788925236.690343:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819200:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788925236.690444:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.690548:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.690623:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819200 00000100:00100000:2.0:1788925236.690631:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819200 00000100:00100000:2.0:1788925236.690712:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788925236.690722:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:23363:x1875823470819200:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788925236.690749:0:22627:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788925236.690753:0:22627:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1788925236.690801:0:22627:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788925236.691187:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+12:23363:x1875823470819200:12345-0@lo:253:mount.lustre.0 Request processed in 465us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.691195:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925236.691296:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819200:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788925236.691307:0:23363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788925236.691309:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925236.691311:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788925236.691312:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925236.691313:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925236.691314:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925236.691316:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925236.691317:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925236.691318:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925236.691320:0:23363:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788925236.691336:0:23363:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a503ad9800 from lustre-MDT0001 10000000:01000000:1.0:1788925236.691361:0:23363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:1.0:1788925236.691364:0:23363:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:1.0:1788925236.691370:0:23363:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a60841cd40 local copy 00010000:00010000:1.0:1788925236.691380:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925236.691497:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819328:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925236.691529:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925236.691694:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925236.691727:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819328 00000100:00100000:0.0:1788925236.691732:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819328 00000100:00100000:0.0:1788925236.691758:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788925236.691764:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:23363:x1875823470819328:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925236.691838:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:23363:x1875823470819328:12345-0@lo:501:mount.lustre.0 Request processed in 73us (308us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925236.691844:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925236.691911:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819328:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788925236.691924:0:23363:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788925236.691942:0:23363:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788925236.691948:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.691957:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925236.691979:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a503ad9800 10000000:01000000:1.0:1788925236.692003:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788925236.692008:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff97a60841cd40 10000000:01000000:1.0:1788925236.692011:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788925236.692015:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff97a60841cd40 from 1 10000000:01000000:1.0:1788925236.692018:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788925236.692041:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.692049:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.692059:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925236.692096:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819456:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788925236.692124:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925236.692147:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925236.692300:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819456 00000100:00100000:0.0:1788925236.692306:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819456 00000100:00100000:0.0:1788925236.692337:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788925236.692344:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+12:23363:x1875823470819456:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925236.692352:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925236.692364:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858d000/0x45e32cfaf7423b68 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b61 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.692385:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858d000/0x45e32cfaf7423b68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b61 expref: 13 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.692395:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858d000/0x45e32cfaf7423b68 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b61 expref: 13 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.692428:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858d000, rc 0) 00000100:00100000:0.0:1788925236.692464:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+13:23363:x1875823470819456:12345-0@lo:101:mount.lustre.0 Request processed in 121us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.692470:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925236.693397:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925236.693431:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b68 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925236.693440:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b68 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925236.693460:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788925236.693476:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b68 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925236.693483:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c436a00/0x45e32cfaf7423b61 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b68 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925236.693493:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97a503ad9800 10000000:01000000:0.0:1788925236.693536:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788925236.693552:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97a503ad9800 from 1 10000000:01000000:0.0:1788925236.693555:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788925236.693577:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.693586:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.693594:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925236.693610:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819584:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925236.693653:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.693687:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.693737:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819584 00000100:00100000:2.0:1788925236.693744:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819584 00000100:00100000:2.0:1788925236.693783:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788925236.693790:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+13:23363:x1875823470819584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925236.693800:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925236.693810:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166de00/0x45e32cfaf7423b76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b6f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.693840:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166de00/0x45e32cfaf7423b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b6f expref: 14 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.693848:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166de00/0x45e32cfaf7423b76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b6f expref: 14 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.693855:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166de00, rc 0) 00000100:00100000:2.0:1788925236.693931:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+14:23363:x1875823470819584:12345-0@lo:101:mount.lustre.0 Request processed in 141us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.693937:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788925236.694203:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819584:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925236.694215:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b76 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.694222:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b76 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925236.694233:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788925236.694283:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b76 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.694291:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858da00/0x45e32cfaf7423b6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b76 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925236.694298:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788925236.694307:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925236.694312:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97a503ad9800 10000000:01000000:0.0:1788925236.694315:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788925236.694320:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788925236.694322:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788925236.694339:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.694347:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.694354:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925236.694367:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819712:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925236.694439:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.694459:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925236.694499:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819712 00000100:00100000:3.0:1788925236.694504:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819712 00000100:00100000:1.0:1788925236.694569:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925236.694579:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+14:23363:x1875823470819712:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925236.694587:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925236.694596:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c437200/0x45e32cfaf7423b84 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423b7d expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.694611:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c437200/0x45e32cfaf7423b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423b7d expref: 15 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.694619:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c437200/0x45e32cfaf7423b84 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b7d expref: 15 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.694625:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c437200, rc 0) 00000100:00100000:1.0:1788925236.694677:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470819712:12345-0@lo:101:mount.lustre.0 Request processed in 101us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925236.694683:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788925236.695305:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819712:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925236.695320:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b84 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.695338:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423b84 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788925236.696612:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:0.0:1788925236.697383:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925236.700891:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1788925236.700944:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:0.0:1788925236.700959:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:0.0:1788925236.700974:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:0.0:1788925236.701282:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:0.0:1788925236.701300:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:0.0:1788925236.701315:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:0.0:1788925236.701330:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:0.0:1788925236.701344:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:0.0:1788925236.701359:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:0.0:1788925236.701373:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:0.0:1788925236.703744:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:0.0:1788925236.703788:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:0.0:1788925236.703811:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:0.0:1788925236.703833:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:0.0:1788925236.703848:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:0.0:1788925236.703861:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:0.0:1788925236.703874:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:0.0:1788925236.703888:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:0.0:1788925236.703900:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:0.0:1788925236.703929:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:0.0:1788925236.703941:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:0.0:1788925236.703954:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:0.0:1788925236.703970:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:0.0:1788925236.703983:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:0.0:1788925236.704016:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:0.0:1788925236.704034:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:0.0:1788925236.704048:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:0.0:1788925236.704061:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:0.0:1788925236.704075:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:0.0:1788925236.704089:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:0.0:1788925236.704103:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:0.0:1788925236.704117:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:0.0:1788925236.704130:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:0.0:1788925236.704142:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:0.0:1788925236.704155:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:0.0:1788925236.704168:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:0.0:1788925236.704200:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:0.0:1788925236.704216:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:0.0:1788925236.704228:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:0.0:1788925236.704241:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:0.0:1788925236.704252:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:0.0:1788925236.704263:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:0.0:1788925236.704275:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:0.0:1788925236.704305:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:0.0:1788925236.704311:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:0.0:1788925236.704451:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925236.704524:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.704569:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.704657:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819840 00000100:00100000:2.0:1788925236.704664:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819840 00000100:00100000:2.0:1788925236.704716:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788925236.704726:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470819840:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925236.704871:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470819840:12345-0@lo:501:mount.lustre.0 Request processed in 147us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.704878:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925236.704884:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819840:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925236.704924:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819968:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925236.704964:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.704999:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925236.705086:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470819968 00000100:00100000:3.0:1788925236.705091:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470819968 00000100:00100000:3.0:1788925236.705127:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788925236.705135:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470819968:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925236.706802:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470819968:12345-0@lo:503:mount.lustre.0 Request processed in 1662us (1831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925236.706833:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925236.706970:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470819968:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788925236.707632:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925236.707710:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470820096:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925236.707760:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.707926:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.707949:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820096 00000100:00100000:2.0:1788925236.707955:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820096 00000100:00100000:2.0:1788925236.708118:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788925236.708130:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470820096:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925236.709124:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470820096:12345-0@lo:502:mount.lustre.0 Request processed in 992us (1359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.709133:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925236.709227:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470820096:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788925236.709672:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1788925236.709703:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:0.0:1788925236.709725:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:0.0:1788925236.709740:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:0.0:1788925236.709752:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:0.0:1788925236.709775:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:0.0:1788925236.709788:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:0.0:1788925236.709803:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:0.0:1788925236.709816:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:0.0:1788925236.709828:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:0.0:1788925236.709840:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:0.0:1788925236.709851:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:0.0:1788925236.709861:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:0.0:1788925236.709871:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:0.0:1788925236.709882:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:0.0:1788925236.709892:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:0.0:1788925236.709968:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:0.0:1788925236.709984:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:0.0:1788925236.710006:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:0.0:1788925236.710022:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:0.0:1788925236.710035:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:0.0:1788925236.710046:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:0.0:1788925236.710058:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:0.0:1788925236.710071:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:0.0:1788925236.710085:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:0.0:1788925236.710099:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:0.0:1788925236.710112:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:0.0:1788925236.710125:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:0.0:1788925236.710138:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:0.0:1788925236.710152:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:0.0:1788925236.710164:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:0.0:1788925236.710177:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:0.0:1788925236.710191:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:0.0:1788925236.710205:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:0.0:1788925236.710219:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:0.0:1788925236.710248:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:0.0:1788925236.710264:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:0.0:1788925236.710278:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:0.0:1788925236.710366:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:0.0:1788925236.710385:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:0.0:1788925236.710480:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:0.0:1788925236.710502:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:0.0:1788925236.710516:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:0.0:1788925236.710529:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:0.0:1788925236.710564:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470820224:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925236.710622:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.710665:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.710727:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820224 00000100:00100000:2.0:1788925236.710734:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820224 00000100:00100000:2.0:1788925236.710805:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788925236.710812:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470820224:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925236.710912:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470820224:12345-0@lo:502:mount.lustre.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.710919:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788925236.711007:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470820224:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925236.711064:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:1.0:1788925236.711073:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788925236.712309:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925236.712320:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925236.712322:0:23367:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788925236.712327:0:23367:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788925236.712330:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925236.712342:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff97a503b1b380) 00000020:00000080:2.0:1788925236.712360:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788925236.712364:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788925236.712455:0:23367:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788925236.712463:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423b92 00000020:00000080:2.0:1788925236.712654:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788925236.712657:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925236.712660:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925236.712662:0:23367:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788925236.712664:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925236.712668:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925236.712669:0:23367:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788925236.712673:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925236.712687:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff97a625a319c0) 00000020:00000080:2.0:1788925236.712699:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788925236.712703:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788925236.712705:0:23367:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788925236.712707:0:23367:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788925236.712713:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788925236.712767:0:23367:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a503ad9800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788925236.712777:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff97a625a33380) 00000020:00000080:2.0:1788925236.712789:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788925236.712840:0:23367:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788925236.712844:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423ba7 00000020:00000080:2.0:1788925236.712941:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788925236.712947:0:23367:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788925236.712952:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x45e32cfaf7423bae 00080000:01000000:2.0:1788925236.712957:0:23367:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788925236.712960:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423bb5 00010000:00010000:3.0:1788925236.849073:0:23367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788925236.850075:0:23367:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788925236.850977:0:23367:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788925236.855804:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788925236.855817:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925236.855825:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925236.855827:0:23367:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788925236.855830:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925236.855836:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925236.855837:0:23367:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788925236.855840:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788925236.855845:0:23367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:00000080:2.0:1788925236.855883:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788925236.855898:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff97a625a30000) 00000020:00000080:2.0:1788925236.855919:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788925236.855925:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788925236.856008:0:23367:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788925236.856015:0:23367:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788925236.856022:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423bc3 00010000:00080000:2.0:1788925236.856055:0:23367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a503a19000@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1788925236.861154:0:23367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:3.0:1788925236.863252:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788925236.863266:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788925236.863306:0:23367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788925236.863332:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423bca 00000100:00080000:3.0:1788925236.863344:0:23367:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925236.863358:0:23367:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff97a503a19000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925236.863393:0:23367:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e35b480 x1875823470820352/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925236.863451:0:23367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:3.0:1788925236.863804:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925236.863809:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.863811:0:23367:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:3.0:1788925236.863814:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788925236.863817:0:23367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1788925236.863818:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788925236.863820:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788925236.863822:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788925236.863824:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.863825:0:23367:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788925236.863828:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925236.863832:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.863833:0:23367:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:3.0:1788925236.863837:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788925236.864827:0:23367:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788925236.865005:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470820352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788925236.865072:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925236.865169:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788925236.865174:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788925236.865176:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925236.865181:0:16480:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:2.0:1788925236.865193:0:16480:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788925236.865201:0:16480:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97a610e87800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925236.865220:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71ce00 x1875823470820608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788925236.865235:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.865239:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925236.865242:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.865245:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788925236.865285:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820352 00000100:00100000:2.0:1788925236.865291:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820352 00000100:00100000:2.0:1788925236.865319:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788925236.865324:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3620:x1875823470820352:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788925236.865347:0:22638:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000020:00000080:2.0:1788925236.865392:0:22638:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423bd1 00000004:00100000:2.0:1788925236.865427:0:22638:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788925236.865433:0:22638:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000020:01000000:3.0:1788925236.865598:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925236.865609:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.865611:0:23367:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:3.0:1788925236.865615:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788925236.865618:0:23367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:3.0:1788925236.865619:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788925236.865620:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788925236.865622:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788925236.865624:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.865626:0:23367:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788925236.865628:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788925236.865633:0:23367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:3.0:1788925236.865636:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.865637:0:23367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788925236.865640:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788925236.865644:0:23367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:3.0:1788925236.865663:0:23367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:3.0:1788925236.865666:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788925236.865680:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff97a60ac93380) 00000020:00000080:3.0:1788925236.865695:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788925236.865702:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:0.0:1788925236.866025:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470820480:0@lo:400:kworker.0 00000100:00100000:0.0:1788925236.866067:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.866105:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820480 00000100:00100000:0.0:1788925236.866110:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820480 00000004:00080000:3.0:1788925236.868460:0:23367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:3.0:1788925236.868472:0:23367:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788925236.868483:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423bdf 00010000:00080000:3.0:1788925236.871136:0:23367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a63f7cd800@lustre-OST0000-osc-MDT0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1788925236.871380:0:23367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:2.0:1788925236.872973:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470820736:0@lo:400:kworker.0 00000100:00100000:2.0:1788925236.873055:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925236.873124:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820736 00000100:00100000:2.0:1788925236.873132:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820736 00000100:00100000:2.0:1788925236.873178:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925236.873187:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470820736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925236.873238:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470820736:12345-0@lo:400:kworker.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.873245:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788925236.873280:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470820608:0@lo:38:kworker.0 00000100:00100000:2.0:1788925236.873310:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788925236.873350:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a63c71e300 x1875823470820736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925236.873363:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470820736:0@lo:400:kworker.0 00000100:00100000:0.0:1788925236.873829:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788925236.873842:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:3624:x1875823470820480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925236.873902:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+15:3624:x1875823470820480:12345-0@lo:400:kworker.0 Request processed in 65us (7834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.873909:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788925236.873942:0:22637:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788925236.873949:0:22637:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788925236.873974:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470820480:0@lo:400:kworker.0 00000100:00100000:0.0:1788925236.874135:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820608 00000100:00100000:0.0:1788925236.874140:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820608 00000100:00100000:0.0:1788925236.874229:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925236.874235:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875823470820608:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788925236.874283:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875823470820608:12345-0@lo:38:kworker.0 Request processed in 47us (972us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788925236.874290:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925236.874326:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925236.874334:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925236.874338:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788925236.874341:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470820608:0@lo:38:kworker.0 00000100:00080000:2.0:1788925236.884131:0:22638:0:(import.c:65:import_set_state_nolock()) ffff97a503a1c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925236.884227:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1875823470820352:12345-0@lo:38:llog_process_th.0 Request processed in 18899us (19152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.884237:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:01000000:1.0:1788925236.885618:0:23367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788925236.887278:0:23367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788925236.887482:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925236.887728:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788925236.887739:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788925236.887745:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788925236.887748:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a503a19000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788925236.887770:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470820352:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788925236.887879:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925236.887896:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470820864:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925236.887957:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.889754:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470820864 00000100:00100000:0.0:1788925236.889765:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470820864 00000100:00100000:0.0:1788925236.889817:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925236.889825:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875823470820864:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788925236.889998:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925236.890128:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3621:x1875823470820864:12345-0@lo:41:osp-pre-0-1.0 Request processed in 303us (2169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.890136:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000040:00080000:3.0:1788925236.900445:0:23367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925236.901099:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470820864:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788925236.901496:0:23367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788925236.901655:0:23367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788925236.904280:0:23373:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788925236.904288:0:23373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788925236.905096:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788925236.905108:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788925236.905149:0:23367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788925236.905170:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423be6 00000100:00080000:1.0:1788925236.905180:0:23367:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925236.905191:0:23367:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97a63f7cd800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925236.905224:0:23367:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b1f80 x1875823470820992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925236.905253:0:23367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788925236.905314:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925236.905318:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.905320:0:23367:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788925236.905323:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788925236.905325:0:23367:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788925236.905326:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925236.905328:0:23367:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925236.905329:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788925236.905331:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.905333:0:23367:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788925236.905335:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788925236.905339:0:23367:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788925236.905342:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.905344:0:23367:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788925236.905348:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788925236.905351:0:23367:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.151@tcp to nid 0x20000c0a8ce97 (192.168.206.151@tcp) 00000020:01000000:1.0:1788925236.905377:0:23367:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788925236.905380:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788925236.905391:0:23367:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff97a63599b380) 00000020:00000080:1.0:1788925236.905431:0:23367:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788925236.905438:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788925236.905492:0:23367:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788925236.905498:0:23367:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788925236.905517:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x45e32cfaf7423bf4 00010000:00080000:1.0:1788925236.905542:0:23367:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a501e69800@lustre-OST0001-osc-MDT0001: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1788925236.905736:0:23367:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788925236.905798:0:23367:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788925236.905812:0:23367:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:0.0:1788925236.906666:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470820992:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788925236.906733:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470820992 offset 0 length 520: 4 00000100:00080000:2.0:1788925236.907450:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.907456:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925236.907459:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.907462:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788925236.908522:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000040:00080000:1.0:1788925236.911069:0:23367:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925236.911458:0:23367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788925236.911627:0:23367:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788925236.912261:0:23375:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788925236.912266:0:23375:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788925236.913360:0:23367:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788925236.913372:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788925236.913445:0:23367:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788925236.913466:0:23367:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423bfb 00000100:00080000:1.0:1788925236.913474:0:23367:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925236.913484:0:23367:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925236.913708:0:23367:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b3b80 x1875823470821120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925236.913767:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470821120:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788925236.913825:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470821120 offset 0 length 520: 4 00000100:00080000:1.0:1788925236.913886:0:23367:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788925236.913943:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925236.913948:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.913949:0:23367:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788925236.913952:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925236.913955:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.913957:0:23367:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788925236.913965:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788925236.913967:0:23367:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788925236.913970:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925236.913972:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.913973:0:23367:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788925236.913975:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925236.913978:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.913979:0:23367:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788925236.913982:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788925236.914018:0:23367:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925236.914021:0:23367:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925236.914023:0:23367:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788925236.914026:0:23367:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:1.0:1788925236.914075:0:23363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:1.0:1788925236.914115:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788925236.914129:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b84 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914140:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858d400/0x45e32cfaf7423b7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423b84 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925236.914149:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a503ad9800 from 1 10000000:01000000:1.0:1788925236.914152:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788925236.914174:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914182:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914193:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925236.914207:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788925236.914245:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925236.914261:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276480 going to sleep for 11 seconds 00000100:00100000:1.0:1788925236.914285:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821248 00000100:00100000:1.0:1788925236.914291:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821248 00000100:00100000:1.0:1788925236.914327:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788925236.914335:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+15:23363:x1875823470821248:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925236.914346:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925236.914358:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c02 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914380:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 16 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914391:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 16 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.914426:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c436c00, rc 0) 00000100:00100000:1.0:1788925236.914457:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+16:23363:x1875823470821248:12345-0@lo:101:mount.lustre.0 Request processed in 123us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925236.914464:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788925236.914730:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.914736:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925236.914738:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925236.914741:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925236.914979:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925236.915005:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925236.915015:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925236.916062:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821376:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788925236.916203:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925236.916293:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.922547:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821376 00000100:00100000:2.0:1788925236.922562:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821376 00000100:00100000:1.0:1788925236.922761:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788925236.922772:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+16:23363:x1875823470821376:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788925236.922799:0:22626:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788925236.922823:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788925236.922827:0:22626:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788925236.922980:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+16:23363:x1875823470821376:12345-0@lo:256:mount.lustre.0 Request processed in 210us (6776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925236.923000:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925236.923118:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821376:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1788925236.923835:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788925236.923862:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925236.923874:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925236.923882:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a503ad9800 from 1 10000000:01000000:3.0:1788925236.923885:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925236.923915:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925236.923923:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925236.923932:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925236.923950:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925236.923989:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925236.924033:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a612b8b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.924639:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821504 00000100:00100000:2.0:1788925236.924647:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821504 00000100:00100000:2.0:1788925236.924693:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925236.924701:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+16:23363:x1875823470821504:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925236.924713:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925236.924725:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c10 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.924746:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.924756:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.924764:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166d600, rc 0) 00000100:00100000:2.0:1788925236.924804:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821504:12345-0@lo:101:mount.lustre.0 Request processed in 104us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.924810:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925236.924853:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821504:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925236.924880:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925236.924890:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788925236.937868:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1788925236.938189:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925236.938754:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788925236.938785:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1788925236.938814:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1788925236.938828:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1788925236.938841:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1788925236.938854:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1788925236.938938:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1788925236.938954:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1788925236.938969:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788925236.939008:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1788925236.939025:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1788925236.939044:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1788925236.939049:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1788925236.939135:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925236.939195:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925236.939246:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a612b8b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.939930:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821632 00000100:00100000:2.0:1788925236.939939:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821632 00000100:00100000:2.0:1788925236.940017:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788925236.940027:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821632:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925236.940172:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821632:12345-0@lo:501:mount.lustre.0 Request processed in 146us (976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925236.940179:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788925236.940541:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925236.940717:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925236.940765:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925236.940801:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a612b8b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788925236.940872:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821760 00000100:00100000:0.0:1788925236.940877:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821760 00000100:00100000:0.0:1788925236.940916:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925236.940923:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821760:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925236.941030:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821760:12345-0@lo:503:mount.lustre.0 Request processed in 107us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.941037:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788925236.941239:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788925236.942042:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788925236.942777:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821888:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925236.942855:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.943021:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925236.943064:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470821888 00000100:00100000:1.0:1788925236.943071:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470821888 00000100:00100000:1.0:1788925236.943225:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925236.943235:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821888:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925236.945181:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470821888:12345-0@lo:502:mount.lustre.0 Request processed in 1941us (2318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925236.945195:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788925236.945314:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470821888:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925236.945800:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788925236.945835:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:3.0:1788925236.945852:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:3.0:1788925236.945897:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:3.0:1788925236.945915:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:3.0:1788925236.945929:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:3.0:1788925236.945943:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:3.0:1788925236.945957:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:3.0:1788925236.945971:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788925236.945984:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:3.0:1788925236.946013:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:3.0:1788925236.946053:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925236.946123:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.950495:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822016 00000100:00100000:0.0:1788925236.950508:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822016 00000100:00100000:0.0:1788925236.950559:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925236.950568:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470822016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925236.950718:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470822016:12345-0@lo:502:mount.lustre.0 Request processed in 150us (4594us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.950725:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788925236.950900:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a612b8b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788925236.950926:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788925236.951024:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788925236.951037:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788925236.952052:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925236.952062:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.952065:0:23377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788925236.952072:0:23377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a503ad9800 00000020:00000080:3.0:1788925236.952075:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925236.952165:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925236.952170:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.952171:0:23377:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788925236.952174:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925236.952177:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.952178:0:23377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788925236.952182:0:23377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a503ad9800 00000020:00000080:3.0:1788925236.952184:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925236.952276:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925236.952280:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.952281:0:23377:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788925236.952283:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925236.952286:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925236.952287:0:23377:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788925236.952291:0:23377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a503ad9800 00000020:00000080:3.0:1788925236.952293:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925236.952968:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925236.963207:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925236.963215:0:23377:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788925236.963227:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925236.963233:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925236.963235:0:23377:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788925236.963240:0:23377:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a503ad9800 00000020:00000080:0.0:1788925236.963243:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788925236.963320:0:23377:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925236.963324:0:23377:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925236.963325:0:23377:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788925236.963342:0:23377:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788925236.967987:0:23363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788925236.968049:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925236.968073:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968094:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925236.968152:0:23363:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788925236.968154:0:23363:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a503ad9800 10000000:01000000:0.0:1788925236.968158:0:23363:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a503ad9800 10000000:01000000:0.0:1788925236.968162:0:23363:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925236.968175:0:23363:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a503ad9800 from 1 10000000:01000000:0.0:1788925236.968177:0:23363:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788925236.968211:0:23363:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968220:0:23363:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968230:0:23363:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925236.968252:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822144:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925236.968317:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925236.968358:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822144 00000100:00100000:0.0:1788925236.968365:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822144 00000100:00100000:0.0:1788925236.968428:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925236.968437:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470822144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925236.968449:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925236.968460:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858d600/0x45e32cfaf7423c25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c1e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968482:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858d600/0x45e32cfaf7423c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c1e expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968493:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858d600/0x45e32cfaf7423c25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c1e expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968500:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858d600, rc 0) 00000100:00100000:0.0:1788925236.968533:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822144:12345-0@lo:101:mount.lustre.0 Request processed in 98us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925236.968549:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925236.968594:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592000 going to sleep for 11 seconds 00000100:00100000:0.0:1788925236.968617:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822144:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925236.968631:0:23363:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c25 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925236.968639:0:23363:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c25 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788925236.985983:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1788925236.986975:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925236.987304:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1788925236.987332:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1788925236.987346:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1788925236.987358:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1788925236.987371:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1788925236.987383:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1788925236.987396:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1788925236.987970:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1788925236.988000:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1788925236.988017:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1788925236.988031:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1788925236.988061:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1788925236.989023:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1788925236.989069:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1788925236.989671:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1788925236.989695:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1788925236.989707:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1788925236.989719:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1788925236.989731:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1788925236.989758:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1788925236.989771:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1788925236.989785:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1788925236.989798:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1788925236.989812:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1788925236.989825:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1788925236.989839:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788925236.999697:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788925236.999764:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788925236.999780:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788925236.999792:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788925236.999803:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788925236.999814:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788925236.999828:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788925236.999841:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788925236.999856:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788925236.999869:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788925236.999885:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788925236.999910:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788925236.999925:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788925236.999942:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788925236.999960:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788925236.999978:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788925237.000013:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788925237.000028:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788925237.000041:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788925237.000054:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788925237.000068:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788925237.000083:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788925237.000320:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788925237.000343:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788925237.000361:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788925237.000367:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788925237.000567:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925237.000626:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.000665:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925237.009802:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822272 00000100:00100000:2.0:1788925237.009815:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822272 00000100:00100000:0.0:1788925237.011366:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925237.011384:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925237.011561:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822272:12345-0@lo:501:mount.lustre.0 Request processed in 185us (10934us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925237.011570:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925237.011722:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822272:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925237.011769:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822400:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788925237.011818:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925237.011915:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822400 00000100:00100000:2.0:1788925237.011922:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822400 00000100:00100000:1.0:1788925237.014979:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925237.015254:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788925237.015270:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822400:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925237.015451:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822400:12345-0@lo:503:mount.lustre.0 Request processed in 186us (3631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925237.015459:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925237.015553:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822400:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788925237.018005:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925237.018105:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925237.018173:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.018774:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925237.020755:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822528 00000100:00100000:0.0:1788925237.020770:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822528 00000100:00100000:0.0:1788925237.020820:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788925237.020829:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822528:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925237.021003:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822528:12345-0@lo:502:mount.lustre.0 Request processed in 175us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925237.021010:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788925237.021183:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925237.021531:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788925237.021575:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788925237.021591:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788925237.021603:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788925237.021615:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788925237.021627:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788925237.021640:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788925237.021651:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788925237.021662:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788925237.021671:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788925237.021681:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788925237.021692:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788925237.021703:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788925237.021713:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788925237.021723:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788925237.021732:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788925237.021742:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788925237.021762:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788925237.021776:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788925237.021787:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788925237.021798:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788925237.021810:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788925237.021821:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788925237.021834:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788925237.021845:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788925237.022065:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788925237.022163:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788925237.022181:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788925237.022193:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788925237.022206:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788925237.022220:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788925237.022231:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788925237.022255:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788925237.022281:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788925237.022296:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788925237.022309:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788925237.022321:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788925237.022950:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788925237.022987:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788925237.023019:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788925237.023035:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788925237.023048:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788925237.023062:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788925237.023075:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788925237.023720:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788925237.023736:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788925237.023750:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788925237.023764:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788925237.023840:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822656:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925237.024010:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.024110:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276240 going to sleep for 11 seconds 00000100:00100000:2.0:1788925237.026960:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822656 00000100:00100000:2.0:1788925237.026976:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822656 00000100:00100000:2.0:1788925237.027108:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788925237.027118:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822656:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925237.027284:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822656:12345-0@lo:502:mount.lustre.0 Request processed in 168us (3274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925237.027293:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788925237.027390:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822656:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925237.027596:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788925237.027621:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788925237.027650:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822784:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925237.027688:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.028229:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925237.030232:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822784 00000100:00100000:0.0:1788925237.030246:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822784 00000100:00100000:0.0:1788925237.030297:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788925237.030306:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925237.030495:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470822784:12345-0@lo:502:mount.lustre.0 Request processed in 190us (2806us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925237.030503:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925237.032667:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470822784:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925237.032771:0:23363:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788925237.032785:0:23363:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788925237.037784:0:23384:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788925237.037808:0:23384:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff97a63599cd40) 00000020:00000080:1.0:1788925237.037834:0:23384:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788925237.037920:0:23384:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a503ad9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788925237.037925:0:23384:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a503ad9800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788925237.037928:0:23384:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a503ad9800 3 00010000:00080000:1.0:1788925237.037968:0:23384:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a50258e800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.151@tcp at head 00010000:00010000:1.0:1788925237.041046:0:23384:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788925237.041381:0:23384:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788925237.041460:0:23384:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788925237.041474:0:23384:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x45e32cfaf7423c33 00000100:00080000:1.0:1788925237.041483:0:23384:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788925237.041558:0:23384:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff97a50258e800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925237.041592:0:23384:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b1880 x1875823470822912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925237.041616:0:23384:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788925237.041643:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925237.041647:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925237.041649:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925237.041652:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788925237.043069:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875823470822912:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788925237.043167:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.043610:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470822912 00000100:00100000:1.0:1788925237.043618:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470822912 00000100:00100000:1.0:1788925237.043652:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925237.043659:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875823470822912:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788925237.043683:0:22634:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 623 last 0 00000040:00080000:3.0:1788925237.047010:0:23384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:00000080:1.0:1788925237.047782:0:22634:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x45e32cfaf7423c3a 00000020:01000000:1.0:1788925237.047801:0:23363:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788925237.047842:0:23363:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788925237.047858:0:23363:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c25 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.047870:0:23363:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858c800/0x45e32cfaf7423c1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c25 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788925237.047918:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788925237.047920:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788925237.047921:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925237.047923:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925237.047924:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925237.047925:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925237.047926:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925237.047928:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925237.047930:0:23363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925237.047934:0:23363:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788925237.047936:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788925237.047937:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788925237.047939:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925237.047940:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925237.047940:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925237.047941:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925237.047942:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925237.047943:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925237.047944:0:23363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925237.047970:0:23363:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788925237.047988:0:23363:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470823040:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788925237.048260:0:23363:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.048297:0:23363:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6011ca9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925237.048615:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823040 00000100:00100000:3.0:1788925237.048623:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823040 00000100:00100000:3.0:1788925237.048665:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788925237.048675:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:23363:x1875823470823040:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788925237.048700:0:22625:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788925237.048714:0:22625:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:3.0:1788925237.049927:0:22612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:3.0:1788925237.049959:0:22625:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788925237.049968:0:22625:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788925237.050039:0:22648:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788925237.050044:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788925237.050063:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050086:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050094:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 18 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050101:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050131:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 18 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050145:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 18 pid: 22627 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925237.050157:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470823168:0@lo:104: 00000100:00100000:3.0:1788925237.050248:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925237.050283:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050291:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925237.050299:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470823296:0@lo:104: 00000100:00100000:3.0:1788925237.050320:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925237.050348:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a612b8b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788925237.050379:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823168 00000100:00100000:3.0:1788925237.050385:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823168 00000100:00100000:3.0:1788925237.050436:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823296 00000100:00100000:3.0:1788925237.050438:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823296 00000100:00100000:3.0:1788925237.050452:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925237.050458:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470823168:12345-0@lo:104: 00010000:00010000:3.0:1788925237.050469:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050723:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925237.050729:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470823168:12345-0@lo:104: Request processed in 271us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925237.050736:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925237.050752:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925237.050758:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470823296:12345-0@lo:104: 00010000:00010000:3.0:1788925237.050765:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050795:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925237.050799:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470823296:12345-0@lo:104: Request processed in 42us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925237.050803:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788925237.050818:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925237.050823:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050829:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436e00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925237.050832:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050850:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925237.050856:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925237.050862:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925237.050885:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050891:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925237.050910:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050917:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c436e00/0x45e32cfaf7423c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c09 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050930:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925237.050933:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050938:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d200 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925237.050940:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050947:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925237.050953:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925237.050962:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788925237.050976:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.050982:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925237.050988:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.051005:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60166d200/0x45e32cfaf7423b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b45 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925237.051019:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925237.051021:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925237.051023:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925237.051048:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470823168:0@lo:104: 00000100:00100000:3.0:1788925237.051056:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470823296:0@lo:104: 00010000:00010000:3.0:1788925237.051073:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051589:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925237.051603:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470823424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925237.051641:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.051673:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925237.051688:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470823552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925237.051712:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.051756:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823424 00000100:00100000:1.0:1788925237.051761:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823424 00010000:00010000:1.0:1788925237.051784:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 19 pid: 22627 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925237.051805:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823552 00000100:00100000:1.0:1788925237.051808:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823552 00010000:00010000:1.0:1788925237.051817:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 20 pid: 22626 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925237.051829:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925237.051835:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+20:3623:x1875823470823424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925237.051845:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925237.051849:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 20 pid: 22627 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051859:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 20 pid: 22627 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051873:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c436c00/0x45e32cfaf7423c09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c02 expref: 20 pid: 22627 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051884:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925237.051910:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+19:3623:x1875823470823424:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.051916:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925237.051928:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925237.051934:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+18:3623:x1875823470823552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925237.051947:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925237.051951:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051960:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051970:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a61858cc00/0x45e32cfaf7423b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423b3e expref: 18 pid: 22626 timeout: 723 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051981:0:22619:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.051999:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788925237.052013:0:22619:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001969803s 00010000:00010000:1.0:1788925237.052018:0:22619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052026:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052033:0:22619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052039:0:22619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052044:0:22619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925237.052048:0:22619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052060:0:22619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.052075:0:22619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925237.052322:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:23363:x1875823470823040:12345-0@lo:253:mount.lustre.0 Request processed in 3648us (4060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925237.052644:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1788925237.053484:0:22648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925237.053564:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.054477:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423c41 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925237.054611:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925237.054677:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+16:3623:x1875823470823552:12345-0@lo:103:ldlm_bl.0 Request processed in 2740us (2961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.054687:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925237.054740:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470823552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925237.054749:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470823424:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788925237.054785:0:23363:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:23363:1875823470823040:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788925237.054798:0:23363:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788925237.054801:0:23363:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925237.054803:0:23363:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788925237.054804:0:23363:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925237.054805:0:23363:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925237.054806:0:23363:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925237.054808:0:23363:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925237.054809:0:23363:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788925237.054811:0:23363:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925237.054812:0:23363:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788925237.054825:0:23363:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000004:00100000:1.0:1788925237.061026:0:22634:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788925237.061071:0:22634:0:(import.c:65:import_set_state_nolock()) ffff97a606232800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925237.062020:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3620:x1875823470822912:12345-0@lo:38:llog_process_th.0 Request processed in 18355us (18847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.062031:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:01000000:1.0:1788925237.068608:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1788925237.068766:0:23388:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1788925237.068776:0:23388:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788925237.068854:0:23389:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:0.0:1788925237.069573:0:23389:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925237.071575:0:23389:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788925237.071652:0:23389:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788925237.072460:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00010000:00080000:2.0:1788925237.073293:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a5039b1880 x1875823470822912/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925247 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925237.073306:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788925237.073317:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788925237.073325:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788925237.073344:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788925237.073348:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a50258e800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788925237.073355:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3620:1875823470822912:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788925237.074110:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470823680:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788925237.074167:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.074202:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635847a80 going to sleep for 11 seconds 00000040:01000000:3.0:1788925237.074842:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788925237.074910:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788925237.075608:0:23363:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788925237.075617:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788925237.075661:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788925237.076447:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823680 00000100:00100000:2.0:1788925237.076457:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823680 00000100:00100000:2.0:1788925237.076514:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788925237.076523:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470823680:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788925237.076618:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470823680:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925237.076625:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925237.076766:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470823680:0@lo:1000:lod0001_rec0000.0 00000040:01000000:1.0:1788925237.076798:0:23390:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788925237.076833:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470823808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788925237.076880:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.076913:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635847a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925237.079038:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823808 00000100:00100000:2.0:1788925237.079051:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823808 00000100:00100000:2.0:1788925237.079107:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788925237.079117:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470823808:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788925237.079281:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470823808:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 166us (2399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925237.079300:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925237.079458:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470823808:0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788925237.079545:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23390:1875823470823936:0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1788925237.079579:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925237.079602:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635847cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925237.080762:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470823936 00000100:00100000:2.0:1788925237.080770:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470823936 00000100:00100000:2.0:1788925237.080810:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788925237.080819:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23390:x1875823470823936:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788925237.080895:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23390:x1875823470823936:12345-0@lo:900:lod0001_rec0000.0 Request processed in 78us (1315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925237.080911:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1788925237.081677:0:23363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00010000:00080000:0.0:1788925237.082275:0:23390:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff97a5039b2a00 x1875823470823936/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788925253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925237.082290:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23390:1875823470823936:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788925237.082367:0:23390:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470824064:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788925237.082438:0:23390:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925237.082473:0:23390:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ec57cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925237.082803:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824064 00000100:00100000:1.0:1788925237.082810:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824064 00000100:00100000:1.0:1788925237.082854:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925237.082874:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470824064:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1788925237.082975:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23390:x1875823470824064:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 102us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925237.082982:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925237.084074:0:23390:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350380 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23390:1875823470824064:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788925237.084136:0:23390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925237.085219:0:23363:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788925237.085292:0:23363:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:0.0:1788925237.087229:0:23390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788925237.090868:0:23390:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788925237.090878:0:23390:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:2.0:1788925237.092129:0:23363:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788925237.093247:0:23363:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:0.0:1788925237.105208:0:23363:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788925237.122138:0:23363:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788925237.122172:0:23363:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb64541d77988 00100000:10000000:1.0:1788925237.122187:0:23363:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788925237.122864:0:23363:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788925237.122897:0:23363:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788925237.123049:0:23363:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788925237.123071:0:23363:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788925237.125325:0:23363:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788925237.127076:0:23363:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788925237.484305:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925237.931825:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000040:00080000:2.0:1788925238.059390:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1788925238.383648:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788925238.383655:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a503ad9800 from 12 10000000:01000000:1.0:1788925238.383661:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788925238.383708:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.383720:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.383731:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925238.383755:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925238.383835:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925238.383887:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62185f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788925238.383961:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824192 00000100:00100000:3.0:1788925238.383969:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824192 00000100:00100000:3.0:1788925238.384033:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788925238.384043:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+16:22630:x1875823470824192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925238.384060:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925238.384073:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c48 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925238.384103:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925238.384114:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925238.384122:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f07200, rc 0) 00000100:00100000:3.0:1788925238.384166:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470824192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925238.384173:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925238.384333:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925238.384347:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.384356:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925238.384443:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824320:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788925238.384475:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925238.384498:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62185f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925238.384552:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824320 00000100:00100000:0.0:1788925238.384558:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824320 00000100:00100000:0.0:1788925238.384587:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788925238.384594:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470824320:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788925238.384609:0:22627:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788925238.384625:0:22627:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788925238.384628:0:22627:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:0.0:1788925238.384715:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470824320:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925238.384732:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925238.384794:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824320:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788925238.384839:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788925238.384850:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.384859:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925238.384869:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788925238.384871:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a62e331000 from 12 10000000:01000000:1.0:1788925238.384874:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788925238.384892:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.384900:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.384908:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925238.384922:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925238.384947:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925238.384972:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62185f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925238.385022:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824448 00000100:00100000:0.0:1788925238.385028:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824448 00000100:00100000:0.0:1788925238.385058:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788925238.385065:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470824448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925238.385081:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925238.385090:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c56 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925238.385105:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925238.385113:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925238.385119:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858ce00, rc 0) 00000100:00100000:0.0:1788925238.385145:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470824448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925238.385150:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925238.385267:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925238.385278:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.385286:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925238.385320:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824576:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788925238.385354:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925238.385376:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62185f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788925238.385388:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824576 00000100:00100000:1.0:1788925238.385391:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824576 00000100:00100000:1.0:1788925238.385429:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925238.385436:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470824576:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788925238.385446:0:22627:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788925238.385457:0:22627:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788925238.385460:0:22627:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1788925238.385523:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470824576:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925238.385530:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925238.385558:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470824576:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788925238.385588:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788925238.385594:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.385601:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925238.506991:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925238.955488:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000040:00080000:1.0:1788925239.085307:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788925239.530646:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925239.979821:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:1.0:1788925240.557255:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925241.005867:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00010000:00010000:3.0:1788925241.586371:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788925241.896356:0:23632:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788925242.027225:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 0 seconds 00000100:00100000:0.0:1788925242.027741:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470824704:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925242.027918:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925242.028175:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824704 00000100:00100000:1.0:1788925242.028184:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824704 00000100:00100000:1.0:1788925242.028240:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925242.028249:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470824704:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788925242.028291:0:22638:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788925242.028345:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470824704:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925242.028352:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925242.029190:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470824704:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788925242.538764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788925242.538770:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788925242.538774:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925242.538788:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff97a610e87800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925242.538810:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5039b3480 x1875823470824960/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925242.538840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925242.538844:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925242.538846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925242.538849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925242.538880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925242.538883:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925242.538886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925242.538889:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925242.539025:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470824832:0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539091:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925242.539150:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470824960:0@lo:38:kworker.0 00000100:00100000:1.0:1788925242.539178:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925242.539223:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470825088:0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539251:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925242.539269:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788925242.539274:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470825216:0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539293:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925242.539323:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824832 00000100:00100000:1.0:1788925242.539330:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824832 00000100:00100000:1.0:1788925242.539371:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788925242.539380:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:3622:x1875823470824832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539463:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:3622:x1875823470824832:12345-0@lo:400:kworker.0 Request processed in 68us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925242.539470:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788925242.539501:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825088 00000100:00100000:1.0:1788925242.539505:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825088 00000100:00100000:1.0:1788925242.539528:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825216 00000100:00100000:1.0:1788925242.539531:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825216 00000100:00100000:1.0:1788925242.539544:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925242.539549:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470825088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539585:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470825088:12345-0@lo:400:kworker.0 Request processed in 35us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925242.539591:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925242.539602:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925242.539608:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470825216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539634:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470825216:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925242.539639:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788925242.539676:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a5039b2a00 x1875823470825216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925242.539696:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470825216:0@lo:400:kworker.0 00010000:00080000:1.0:1788925242.539710:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a5039b1180 x1875823470825088/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925242.539717:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470825088:0@lo:400:kworker.0 00000100:00100000:1.0:1788925242.539746:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470824832:0@lo:400:kworker.0 00000100:00100000:2.0:1788925242.541537:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470824960 00000100:00100000:2.0:1788925242.541550:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470824960 00000100:00100000:2.0:1788925242.541591:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925242.541599:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3620:x1875823470824960:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788925242.541632:0:23372:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 628 last 0 00000020:00000080:2.0:1788925242.541671:0:23372:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423c64 00000004:00100000:2.0:1788925242.541688:0:23372:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788925242.541693:0:23372:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:3.0:1788925242.553242:0:23372:0:(import.c:65:import_set_state_nolock()) ffff97a63f7c9800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925242.553599:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875823470824960:12345-0@lo:38:kworker.0 Request processed in 11985us (14404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925242.553613:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788925242.554448:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788925242.554464:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788925242.554472:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788925242.554476:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e87800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788925242.554521:0:3620:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000007f671c50): req@ffff97a62e359880 x1875823470817792/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925242.554550:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470824960:0@lo:38:kworker.0 00000100:00100000:2.0:1788925242.554618:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470825344:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788925242.554680:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925242.554788:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825344 00000100:00100000:0.0:1788925242.554799:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825344 00000100:00100000:0.0:1788925242.554863:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925242.554874:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875823470825344:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925242.554915:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925242.555154:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3621:x1875823470825344:12345-0@lo:41:osp-pre-1-0.0 Request processed in 282us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925242.555165:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925242.555208:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470825344:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925242.555325:0:22673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925242.555359:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618551480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925242.555383:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470817792 00000100:00100000:2.0:1788925242.555393:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470817792 00000100:00100000:2.0:1788925242.555462:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788925242.555472:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470817792:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788925242.555576:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470817792:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 106us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925242.555584:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925242.555634:0:22673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22673:1875823470817792:0@lo:1000:lod0000_rec0001.0 00000040:01000000:0.0:1788925242.555686:0:22673:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788925242.555734:0:22673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22673:1875823470825472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788925242.555773:0:22673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925242.555796:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788925242.557378:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825472 00000100:00100000:2.0:1788925242.557390:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825472 00000100:00100000:2.0:1788925242.557447:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925242.557456:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470825472:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788925242.557607:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470825472:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 152us (1833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925242.557615:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925242.557655:0:22673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22673:1875823470825472:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788925242.557740:0:22673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22673:1875823470825600:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788925242.557773:0:22673:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925242.557791:0:22673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a601377000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925242.557809:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825600 00000100:00100000:2.0:1788925242.557825:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825600 00000100:00100000:2.0:1788925242.557867:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788925242.557876:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470825600:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788925242.557952:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22673:x1875823470825600:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925242.557958:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788925242.559336:0:22673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22673:1875823470825600:0@lo:1000:lod0000_rec0001.0 00000040:00080000:3.0:1788925242.559430:0:22673:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925242.566753:0:22673:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788925242.566819:0:22673:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 20, retries 0 00000004:00080000:1.0:1788925242.566824:0:22673:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1788925242.602807:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788925242.901606:0:23684:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788925242.902040:0:23684:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788925243.631058:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788925243.881786:0:23735:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788925243.882005:0:23735:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788925244.013774:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788925244.650757:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788925245.251166:0:23783:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff9f997d80 20000000:00000080:2.0:1788925245.251187:0:23783:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a6252fec00 uarg=0000000000000000 20000000:01000000:2.0:1788925245.251227:0:23783:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788925245.251234:0:23783:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788925245.251239:0:23783:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788925245.252084:0:23784:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788925245.252231:0:23783:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788925245.259662:0:23783:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788925245.259694:0:23783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259713:0:23783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259721:0:23783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259730:0:23783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259771:0:23783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259784:0:23783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925245.259824:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875823470825728:0@lo:104: 00000100:00100000:2.0:1788925245.259888:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788925245.259937:0:23783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.259956:0:23783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 17 pid: 22626 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925245.259965:0:23783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875823470825856:0@lo:104: 00000100:00100000:2.0:1788925245.259983:0:23783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925245.260005:0:23783:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62185fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925245.260067:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825728 00000100:00100000:3.0:1788925245.260074:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825728 00000100:00100000:3.0:1788925245.260107:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825856 00000100:00100000:3.0:1788925245.260108:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825856 00000100:00100000:3.0:1788925245.260120:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925245.260127:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:23783:x1875823470825728:12345-0@lo:104: 00010000:00010000:3.0:1788925245.260139:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260193:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925245.260199:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:23783:x1875823470825728:12345-0@lo:104: Request processed in 73us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925245.260205:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925245.260219:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925245.260224:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:23783:x1875823470825856:12345-0@lo:104: 00010000:00010000:3.0:1788925245.260230:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260257:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788925245.260262:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:23783:x1875823470825856:12345-0@lo:104: Request processed in 38us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925245.260267:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788925245.260290:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925245.260295:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260313:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06000 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925245.260317:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260325:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925245.260332:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925245.260338:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925245.260364:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260370:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925245.260388:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260395:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423c10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c17 expref: -99 pid: 23363 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260433:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925245.260436:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260443:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c000 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925245.260445:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260462:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788925245.260468:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925245.260473:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788925245.260486:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260492:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925245.260507:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260513:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60166c000/0x45e32cfaf7423b0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423b14 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260528:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925245.260529:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925245.260531:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925245.260537:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925245.260553:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470825984:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925245.260579:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925245.260608:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470826112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925245.260625:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925245.260649:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470825984 00000100:00100000:3.0:1788925245.260653:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470825984 00010000:00010000:3.0:1788925245.260668:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 18 pid: 22627 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925245.260693:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826112 00000100:00100000:3.0:1788925245.260696:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826112 00010000:00010000:3.0:1788925245.260707:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 19 pid: 22626 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925245.260719:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925245.260724:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+19:3622:x1875823470825984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925245.260733:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925245.260738:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 19 pid: 22627 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260746:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 19 pid: 22627 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260770:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925245.260798:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+19:3622:x1875823470825984:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925245.260805:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925245.260817:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925245.260823:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+18:3623:x1875823470826112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925245.260830:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925245.260834:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 18 pid: 22626 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260842:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 18 pid: 22626 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260853:0:22618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260865:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260878:0:22618:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260885:0:22618:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260892:0:22618:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260898:0:22618:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260903:0:22618:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925245.260907:0:22618:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260914:0:22618:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260922:0:22618:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.260929:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925245.260964:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+18:3623:x1875823470826112:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925245.260970:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788925245.261004:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470826112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925245.261030:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470825984:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925245.261444:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c10 expref: 17 pid: 22627 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925245.261456:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875823470825728:0@lo:104: 00010000:00010000:2.0:1788925245.261465:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a61858c400/0x45e32cfaf7423b14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423b0d expref: 16 pid: 22626 timeout: 731 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925245.261473:0:23783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23783:1875823470825856:0@lo:104: 00010000:00010000:2.0:1788925245.261490:0:23783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.261499:0:23783:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.261505:0:23783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925245.261522:0:23783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60166d200/0x45e32cfaf7423c6b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925245.679071:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788925246.379516:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788925246.379522:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a503ad9800 from 13 10000000:01000000:3.0:1788925246.379528:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788925246.379571:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925246.379582:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925246.379592:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925246.379615:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788925246.380025:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925246.380386:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62189d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925246.380545:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826240 00000100:00100000:2.0:1788925246.380554:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826240 00000100:00100000:2.0:1788925246.380643:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788925246.380729:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+16:22630:x1875823470826240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925246.380743:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925246.380759:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c72 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925246.380782:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925246.380793:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 17 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925246.380803:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166c600, rc 0) 00000100:00100000:2.0:1788925246.380887:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 236us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925246.380893:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788925246.381699:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925246.381717:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925246.381727:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925246.381794:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925246.381830:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925246.381863:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62189d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925246.381995:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826368 00000100:00100000:1.0:1788925246.382002:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826368 00000100:00100000:1.0:1788925246.382052:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925246.382060:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.382170:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.382177:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788925246.382211:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.382240:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.382278:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925246.382293:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60acc5180 going to sleep for 11 seconds 00000100:00100000:1.0:1788925246.382304:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826496 00000100:00100000:1.0:1788925246.382308:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826496 00000100:00100000:1.0:1788925246.382325:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788925246.382330:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.382430:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.382436:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788925246.382474:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788925246.383101:0:23842:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788925246.383153:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788925246.383172:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925246.383180:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383191:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925246.383201:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925246.383203:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a62e331000 from 13 10000000:01000000:1.0:1788925246.383206:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925246.383230:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383238:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383247:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925246.383262:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383295:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925246.383319:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788925246.383339:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826624 00000100:00100000:1.0:1788925246.383344:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826624 00000100:00100000:1.0:1788925246.383365:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925246.383372:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+17:22630:x1875823470826624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925246.383380:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925246.383391:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423c80 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383429:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383438:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 18 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383446:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c437400, rc 0) 00000100:00100000:1.0:1788925246.383475:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470826624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.383481:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925246.383510:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925246.383521:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.383529:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925246.383568:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383591:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925246.383608:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788925246.383625:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826752 00000100:00100000:1.0:1788925246.383629:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826752 00000100:00100000:1.0:1788925246.383650:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925246.383656:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470826752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383731:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470826752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.383737:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788925246.383764:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383788:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383821:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925246.383832:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe540 going to sleep for 11 seconds 00000100:00100000:1.0:1788925246.383843:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470826880 00000100:00100000:1.0:1788925246.383846:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470826880 00000100:00100000:1.0:1788925246.383862:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788925246.383868:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470826880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925246.383928:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:22630:x1875823470826880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.383935:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788925246.383984:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470826880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788925246.389488:0:23843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788925246.389658:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788925246.389684:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925246.389695:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925246.389707:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925246.634546:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925236/real 1788925236] req@ffff97a5039b3b80 x1875823470821120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925246.634581:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b3b80 x1875823470821120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925246.634592:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925236/real 1788925236] req@ffff97a5039b1f80 x1875823470820992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925246 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925246.634628:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b1f80 x1875823470820992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925246 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925246.634770:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925246.634796:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788925246.634801:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470821120:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788925246.634807:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a63f7cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925246.634813:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788925246.634816:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470820992:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788925246.635394:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925246.635399:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925246.635448:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925246.635452:0:16480:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925246.635488:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925246.635492:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788925246.635495:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a63f7cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925246.635500:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1788925246.635507:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00100000:3.0:1788925246.635627:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470827008:0@lo:400:kworker.0 00000100:00100000:3.0:1788925246.635762:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925246.635811:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470827136:0@lo:400:kworker.0 00000100:00100000:3.0:1788925246.635848:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925246.635867:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925246.635872:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470827264:0@lo:400:kworker.0 00000100:00100000:3.0:1788925246.635898:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925246.635932:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827008 00000100:00100000:3.0:1788925246.635951:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827008 00000100:00100000:3.0:1788925246.635995:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827264 00000100:00100000:3.0:1788925246.635998:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827264 00000100:00100000:3.0:1788925246.636014:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925246.636023:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875823470827008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925246.636333:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827136 00000100:00100000:1.0:1788925246.636338:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827136 00000100:00100000:1.0:1788925246.636367:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925246.636374:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470827136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925246.636458:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470827136:12345-0@lo:400:kworker.0 Request processed in 84us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925246.636465:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788925246.636508:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a63c71d500 x1875823470827136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925246.636803:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3624:x1875823470827008:12345-0@lo:400:kworker.0 Request processed in 781us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925246.636810:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788925246.636824:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925246.636842:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470827264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925246.636869:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470827264:12345-0@lo:400:kworker.0 Request processed in 40us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925246.636875:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925246.636905:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470827008:0@lo:400:kworker.0 00000100:00100000:1.0:1788925246.637823:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470827136:0@lo:400:kworker.0 00000100:00100000:1.0:1788925246.637858:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470827264:0@lo:400:kworker.0 00000100:00080000:2.0:1788925246.637952:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97a63f7cd800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925246.637993:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71ea00 x1875823470827392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788925246.638021:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925246.638026:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788925246.638028:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925246.638032:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 623 00000100:00080000:2.0:1788925246.638036:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788925246.638044:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925246.638057:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a63c71ed80 x1875823470827520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925246.638185:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925246.638199:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470827648:0@lo:400:kworker.0 00000100:00100000:1.0:1788925246.638236:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470827392:0@lo:8:kworker.0 00000400:00000100:1.0:1788925246.638264:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470827392 offset 0 length 520: 4 00000100:00100000:3.0:1788925246.638274:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925246.638293:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470827520:0@lo:8:kworker.0 00000400:00000100:1.0:1788925246.638311:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470827520 offset 0 length 520: 4 00000100:00100000:2.0:1788925246.638398:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827648 00000100:00100000:2.0:1788925246.638420:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827648 00000100:00100000:2.0:1788925246.638464:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925246.638472:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875823470827648:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788925246.638726:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a63c71d500 x1875823470827648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925262 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925246.638754:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470827648:0@lo:400:kworker.0 00000100:00100000:2.0:1788925246.638806:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875823470827648:12345-0@lo:400:kworker.0 Request processed in 334us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925246.638813:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788925246.699141:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925247.153451:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470827776:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925247.153548:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.154140:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827776 00000100:00100000:2.0:1788925247.154152:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827776 00000100:00100000:2.0:1788925247.154237:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788925247.154249:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470827776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788925247.154301:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788925247.154371:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470827776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.154379:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925247.155617:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470827776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925247.658550:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925232/real 1788925232] req@ffff97a5039b2680 x1875823470818944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925247.658587:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b2680 x1875823470818944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925247.658599:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925232/real 1788925232] req@ffff97a5039b0e00 x1875823470819072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925247 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925247.658611:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a5039b0e00 x1875823470819072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925247 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788925247.658659:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925247.658686:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788925247.658691:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470818944:0@lo:8:kworker.0 00000100:00080000:1.0:1788925247.658698:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925247.658703:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788925247.658706:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470819072:0@lo:8:kworker.0 00000100:00080000:0.0:1788925247.658917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788925247.658922:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788925247.658925:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925247.658931:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:0.0:1788925247.658946:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788925247.658960:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a610e8a000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925247.658983:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e350e00 x1875823470828160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925247.658996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788925247.658999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788925247.659001:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788925247.659004:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 618 00000100:00080000:0.0:1788925247.659007:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788925247.659012:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925247.659034:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e353480 x1875823470828288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925247.659075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788925247.659079:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788925247.659082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788925247.659085:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788925247.659118:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470828416:0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.659202:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925247.659240:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925247.659247:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470828544:0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.659270:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925247.659434:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470827904:0@lo:400:kworker.0 00000100:00100000:1.0:1788925247.659471:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925247.659504:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788925247.659510:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470828032:0@lo:400:kworker.0 00000100:00100000:1.0:1788925247.659540:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925247.659576:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828416 00000100:00100000:1.0:1788925247.659585:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828416 00000100:00100000:0.0:1788925247.659718:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470827904 00000100:00100000:0.0:1788925247.659723:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470827904 00000100:00100000:0.0:1788925247.659765:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788925247.659776:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:3621:x1875823470827904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.659834:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:3621:x1875823470827904:12345-0@lo:400:kworker.0 Request processed in 60us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.659841:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925247.660043:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925247.660054:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470828672:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788925247.660085:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925247.660116:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828032 00000100:00100000:2.0:1788925247.660119:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828032 00000100:00100000:2.0:1788925247.660148:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828672 00000100:00100000:2.0:1788925247.660151:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828672 00000100:00100000:2.0:1788925247.660164:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925247.660170:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1875823470828032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925247.660208:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:3621:x1875823470828032:12345-0@lo:400:kworker.0 Request processed in 38us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.660215:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925247.660235:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925247.660241:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875823470828672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788925247.660269:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788925247.660308:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3622:x1875823470828672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 67us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925247.660314:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925247.660357:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470828672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925247.660985:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828544 00000100:00100000:1.0:1788925247.660993:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828544 00000100:00100000:0.0:1788925247.664124:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925247.664149:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470828416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925247.664266:0:22633:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788925247.664272:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470828416:12345-0@lo:400:kworker.0 Request processed in 134us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925247.664277:0:22633:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788925247.664279:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925247.664306:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925247.664311:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470828160:0@lo:8:kworker.0 00000100:00100000:0.0:1788925247.664313:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470828544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.664356:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470828544:12345-0@lo:400:kworker.0 Request processed in 44us (5085us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925247.664363:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000400:00000100:3.0:1788925247.664395:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470828160 offset 0 length 520: 4 00010000:00080000:0.0:1788925247.664428:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e353100 x1875823470828544/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925247.664444:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470828544:0@lo:400:kworker.0 00000100:00100000:3.0:1788925247.664446:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470828288:0@lo:8:kworker.0 00010000:00080000:0.0:1788925247.664459:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e351180 x1875823470828416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925263 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000400:00000100:3.0:1788925247.664463:0:3620:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875823470828288 offset 0 length 520: 4 00000100:00100000:0.0:1788925247.664468:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470828416:0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.669697:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470828032:0@lo:400:kworker.0 00000100:00100000:0.0:1788925247.669718:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470827904:0@lo:400:kworker.0 00010000:00010000:3.0:1788925247.724753:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788925248.685606:0:23364:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:3.0:1788925248.746724:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925249.325159:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788925249.779731:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925250.795869:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925251.820494:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925252.271132:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925252.271196:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925252.271256:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828800 00000100:00100000:3.0:1788925252.271263:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828800 00000100:00100000:3.0:1788925252.271304:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925252.271313:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470828800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788925252.271342:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925252.271386:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470828800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925252.271418:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788925252.271461:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470828800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925252.781209:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470828928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925252.781275:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925252.781340:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470828928 00000100:00100000:1.0:1788925252.781348:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470828928 00000100:00100000:1.0:1788925252.781389:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788925252.781397:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470828928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788925252.781449:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788925252.781491:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470828928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 95us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925252.781742:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788925252.781915:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470828928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925252.784714:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:1.0:1788925252.784987:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925252.784992:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925252.785004:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925252.785007:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925252.785040:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925252.785043:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925252.785046:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925252.785048:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788925252.785079:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470829312:0@lo:400:kworker.0 00000100:00100000:1.0:1788925252.785137:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925252.785169:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925252.785174:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470829184:0@lo:400:kworker.0 00000100:00100000:1.0:1788925252.785195:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925252.785222:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829312 00000100:00100000:1.0:1788925252.785229:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829312 00000100:00100000:1.0:1788925252.785270:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829184 00000100:00100000:1.0:1788925252.785274:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829184 00000100:00100000:1.0:1788925252.785294:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925252.785300:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470829312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925252.785344:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470829312:12345-0@lo:400:kworker.0 Request processed in 43us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925252.785365:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925252.785381:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925252.785387:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470829184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925252.785432:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470829184:12345-0@lo:400:kworker.0 Request processed in 45us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925252.785439:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788925252.785473:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a501f28e00 x1875823470829184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925252.785487:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470829184:0@lo:400:kworker.0 00010000:00080000:1.0:1788925252.785497:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a501f28000 x1875823470829312/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925268 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925252.785505:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470829312:0@lo:400:kworker.0 00000100:00100000:3.0:1788925252.787145:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470829056:0@lo:400:kworker.0 00000100:00100000:3.0:1788925252.787206:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925252.790785:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829056 00000100:00100000:0.0:1788925252.790993:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829056 00000100:00100000:1.0:1788925252.798515:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788925252.798529:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:3623:x1875823470829056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925252.799137:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+18:3623:x1875823470829056:12345-0@lo:400:kworker.0 Request processed in 609us (11929us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925252.799146:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788925252.799241:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470829056:0@lo:400:kworker.0 00010000:00010000:3.0:1788925252.842858:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788925253.568771:0:24132:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788925253.568775:0:24132:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788925253.568777:0:24132:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788925253.568884:0:24132:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a503a1e000 00000020:01000004:3.0:1788925253.568898:0:24132:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788925253.568920:0:24132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788925253.568934:0:24132:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff97a501f3cd40) 00000020:00000080:3.0:1788925253.568953:0:24132:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788925253.649442:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788925253.655148:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788925253.656076:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788925253.656852:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788925253.657119:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788925253.657329:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788925253.657710:0:24132:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1788925253.659030:0:24132:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788925253.659260:0:24132:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788925253.659274:0:24132:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788925253.659285:0:24132:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45e32cfaf7423c95 00000020:01000004:3.0:1788925253.659293:0:24132:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788925253.659313:0:24132:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788925253.659321:0:24132:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788925253.659328:0:24132:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788925253.659333:0:24132:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788925253.659344:0:24132:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff97a501f38000) 00000020:00000080:3.0:1788925253.659356:0:24132:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788925253.667367:0:24132:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925253.667947:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788925253.667953:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788925253.670015:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925253.670030:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788925253.679781:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788925253.679797:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788925253.686782:0:24132:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925253.686979:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925253.686986:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788925253.690296:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788925253.690309:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788925253.727640:0:24132:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788925253.727872:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788925253.727878:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788925253.731000:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788925253.731014:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788925253.732725:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788925253.732737:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788925253.734872:0:24132:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925253.735084:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925253.735099:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788925253.736354:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788925253.736364:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788925253.806949:0:24132:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788925253.807138:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788925253.807145:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788925253.815884:0:24132:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788925253.815897:0:24132:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788925253.819369:0:24132:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788925253.819430:0:24132:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788925253.819437:0:24132:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788925253.841887:0:24132:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788925253.841939:0:24132:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.151@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788925253.841944:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788925253.841946:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925253.841947:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925253.841949:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925253.841950:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925253.841952:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925253.841953:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925253.841955:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925253.841956:0:24132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788925253.841960:0:24132:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788925253.841962:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788925253.841964:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925253.841965:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925253.841967:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925253.841968:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925253.841969:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925253.841970:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925253.841971:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925253.841976:0:24132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788925253.842789:0:24132:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788925253.842811:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829440:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788925253.842875:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.842923:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.843060:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829440 00000100:00100000:0.0:1788925253.843068:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829440 00000100:00100000:0.0:1788925253.843127:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788925253.843136:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:24132:x1875823470829440:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788925253.843166:0:22627:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788925253.843169:0:22627:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788925253.843173:0:22627:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788925253.843691:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+18:24132:x1875823470829440:12345-0@lo:253:mount.lustre.0 Request processed in 555us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.843699:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788925253.843963:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829440:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788925253.843974:0:24132:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788925253.843977:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788925253.843979:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788925253.843980:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788925253.843981:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788925253.843982:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788925253.843984:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788925253.843985:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788925253.843986:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788925253.843997:0:24132:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788925253.844015:0:24132:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a503a1e000 from lustre-OST0000 10000000:01000000:3.0:1788925253.844050:0:24132:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788925253.844054:0:24132:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788925253.844061:0:24132:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a60841cd40 local copy 00010000:00010000:3.0:1788925253.844070:0:24132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925253.844153:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925253.844183:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.844205:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.844307:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829568 00000100:00100000:0.0:1788925253.844313:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829568 00000100:00100000:0.0:1788925253.844348:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788925253.844356:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:24132:x1875823470829568:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925253.844446:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:24132:x1875823470829568:12345-0@lo:501:mount.lustre.0 Request processed in 91us (263us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925253.844453:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788925253.844580:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829568:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788925253.844593:0:24132:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788925253.844741:0:24132:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788925253.844747:0:24132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.844763:0:24132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925253.844785:0:24132:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a503a1e000 10000000:01000000:3.0:1788925253.844789:0:24132:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788925253.844794:0:24132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788925253.844796:0:24132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788925253.844800:0:24132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788925253.844803:0:24132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788925253.844822:0:24132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.844830:0:24132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.844838:0:24132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925253.844851:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829696:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925253.844880:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.844896:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.844953:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829696 00000100:00100000:0.0:1788925253.844958:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829696 00000100:00100000:2.0:1788925253.845073:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788925253.845083:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+18:24132:x1875823470829696:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925253.845090:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925253.845101:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166ca00/0x45e32cfaf7423caa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423ca3 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.845120:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166ca00/0x45e32cfaf7423caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423ca3 expref: 19 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.845129:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166ca00/0x45e32cfaf7423caa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423ca3 expref: 19 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.845137:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166ca00, rc 0) 00000100:00100000:2.0:1788925253.845175:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470829696:12345-0@lo:101:mount.lustre.0 Request processed in 94us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925253.845189:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788925253.845256:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829696:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925253.845268:0:24132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423caa expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.845277:0:24132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423caa expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788925253.846265:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788925253.847236:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925253.856284:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788925253.856342:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788925253.856358:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788925253.856371:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788925253.856383:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788925253.856397:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788925253.856481:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788925253.856493:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788925253.856506:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788925253.856518:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788925253.856547:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788925253.856560:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788925253.856584:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788925253.856590:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788925253.857150:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925253.857225:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.857299:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3480 going to sleep for 11 seconds 00000100:00100000:2.0:1788925253.857918:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829824 00000100:00100000:2.0:1788925253.857926:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829824 00000100:00100000:2.0:1788925253.858060:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925253.858070:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470829824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925253.858226:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470829824:12345-0@lo:501:mount.lustre.0 Request processed in 157us (999us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925253.858234:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788925253.858314:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829824:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925253.858350:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829952:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925253.858396:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.870280:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3480 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.870840:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470829952 00000100:00100000:0.0:1788925253.870851:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470829952 00000100:00100000:0.0:1788925253.870910:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788925253.870920:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470829952:12345-0@lo:503:mount.lustre.0 00010000:00010000:3.0:1788925253.874330:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925253.875587:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470829952:12345-0@lo:503:mount.lustre.0 Request processed in 4663us (17184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.875599:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788925253.875739:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470829952:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788925253.876192:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788925253.876265:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830080:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925253.876320:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.876344:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.876512:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830080 00000100:00100000:0.0:1788925253.876519:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830080 00000100:00100000:0.0:1788925253.876544:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788925253.876551:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470830080:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925253.877008:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470830080:12345-0@lo:502:mount.lustre.0 Request processed in 456us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.877016:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788925253.877137:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830080:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925253.877296:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788925253.877320:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788925253.877335:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788925253.877349:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788925253.877364:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788925253.877377:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788925253.877391:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788925253.877435:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788925253.877451:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788925253.877462:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788925253.877486:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788925253.877499:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788925253.877523:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830208:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925253.877559:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925253.877579:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.877812:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830208 00000100:00100000:0.0:1788925253.877823:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830208 00000100:00100000:0.0:1788925253.877845:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788925253.877852:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470830208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925253.877943:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470830208:12345-0@lo:502:mount.lustre.0 Request processed in 90us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.877950:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788925253.878835:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830208:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925253.878915:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788925253.878926:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:3.0:1788925253.881922:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788925253.881934:0:24149:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:3.0:1788925253.881942:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925253.881944:0:24149:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1788925253.881952:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788925253.881971:0:24149:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff97a501f3b380) 00000020:00000080:3.0:1788925253.882011:0:24149:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788925253.882018:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788925253.882112:0:24149:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a503a1e000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1788925253.882121:0:24149:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788925253.882127:0:24149:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x45e32cfaf7423cb8 00010000:00010000:0.0:1788925253.893144:0:24149:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788925253.895309:0:24149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:0.0:1788925253.896916:0:24149:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788925253.915124:0:24149:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788925253.915136:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925253.915142:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915144:0:24149:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788925253.915148:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788925253.915151:0:24149:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:1.0:1788925253.915153:0:24149:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925253.915154:0:24149:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788925253.915168:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788925253.915171:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915173:0:24149:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788925253.915175:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925253.915178:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915180:0:24149:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788925253.915183:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788925253.915185:0:24149:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788925253.915188:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925253.915191:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915192:0:24149:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788925253.915194:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788925253.915197:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915198:0:24149:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788925253.915202:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788925253.915228:0:24149:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788925253.915232:0:24149:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925253.915233:0:24149:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788925253.915237:0:24149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788925253.915624:0:24132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788925253.915650:0:24132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788925253.915666:0:24132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423caa expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.915677:0:24132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f06000/0x45e32cfaf7423ca3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423caa expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925253.915685:0:24132:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a503a1e000 from 1 10000000:01000000:2.0:1788925253.915687:0:24132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925253.915716:0:24132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.915724:0:24132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925253.915734:0:24132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925253.915754:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830336:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788925253.915825:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925253.915862:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618229d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925253.917848:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830336 00000100:00100000:1.0:1788925253.917861:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830336 00000100:00100000:1.0:1788925253.917929:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788925253.917939:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:24132:x1875823470830336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925253.917954:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925253.917969:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423cbf expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925253.918352:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 20 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925253.918365:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 20 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925253.918391:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c436400, rc 0) 00000100:00100000:1.0:1788925253.918488:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830336:12345-0@lo:101:mount.lustre.0 Request processed in 550us (2663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925253.918495:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788925253.918595:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925253.918697:0:24132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.918708:0:24132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925253.922721:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788925253.924087:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925253.924308:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788925253.924333:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788925253.924347:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788925253.924359:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788925253.924371:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788925253.924382:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788925253.924393:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1788925253.925539:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1788925253.925571:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1788925253.925584:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1788925253.925595:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1788925253.925630:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1788925253.925636:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1788925253.925722:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925253.925776:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.925819:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502977e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925253.927246:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830464 00000100:00100000:3.0:1788925253.927259:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830464 00000100:00100000:3.0:1788925253.927316:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788925253.927326:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830464:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925253.927491:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830464:12345-0@lo:501:mount.lustre.0 Request processed in 167us (1713us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.927499:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788925253.934066:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830464:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925253.934125:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830592:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925253.934195:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.934236:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502977e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925253.936678:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830592 00000100:00100000:3.0:1788925253.936690:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830592 00000100:00100000:3.0:1788925253.936743:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788925253.936753:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925253.936931:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830592:12345-0@lo:503:mount.lustre.0 Request processed in 180us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.936939:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788925253.937396:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e352a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830592:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788925253.937838:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925253.938240:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830720:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925253.938294:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925253.938329:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a634f21240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.938419:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830720 00000100:00100000:0.0:1788925253.938426:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830720 00000100:00100000:0.0:1788925253.938462:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788925253.938471:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830720:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925253.938572:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830720:12345-0@lo:502:mount.lustre.0 Request processed in 101us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.938586:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788925253.938977:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830720:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925253.939234:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788925253.939262:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788925253.939275:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788925253.939288:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788925253.939300:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788925253.939313:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788925253.939327:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788925253.939341:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788925253.939366:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788925253.939379:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788925253.939393:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788925253.940117:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925253.940171:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925253.940241:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635839b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925253.947122:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830848 00000100:00100000:3.0:1788925253.947134:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830848 00000100:00100000:3.0:1788925253.947221:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788925253.947231:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830848:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925253.947387:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830848:12345-0@lo:502:mount.lustre.0 Request processed in 158us (7215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.947395:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788925253.947508:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925253.947577:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788925253.947589:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788925253.953446:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925253.953459:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953462:0:24153:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788925253.953470:0:24153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a503a1e000 00000020:00000080:2.0:1788925253.953473:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925253.953481:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925253.953483:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953485:0:24153:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788925253.953487:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925253.953489:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953490:0:24153:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788925253.953494:0:24153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a503a1e000 00000020:00000080:2.0:1788925253.953496:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925253.953551:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925253.953554:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953556:0:24153:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788925253.953558:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925253.953560:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953562:0:24153:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788925253.953565:0:24153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a503a1e000 00000020:00000080:2.0:1788925253.953568:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925253.953585:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925253.953588:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953589:0:24153:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788925253.953591:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788925253.953594:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953595:0:24153:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788925253.953598:0:24153:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a503a1e000 00000020:00000080:2.0:1788925253.953612:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788925253.953638:0:24153:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788925253.953641:0:24153:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788925253.953652:0:24153:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788925253.953656:0:24153:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788925253.964341:0:24132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788925253.964389:0:24132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788925253.964420:0:24132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925253.964433:0:24132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925253.964494:0:24132:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788925253.964497:0:24132:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a503a1e000 10000000:01000000:0.0:1788925253.964500:0:24132:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a503a1e000 10000000:01000000:0.0:1788925253.964504:0:24132:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788925253.964510:0:24132:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a503a1e000 from 1 10000000:01000000:0.0:1788925253.964513:0:24132:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788925253.964547:0:24132:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925253.964556:0:24132:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925253.964567:0:24132:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925253.964590:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830976:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788925253.964655:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.964701:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5029776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925253.964998:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470830976 00000100:00100000:3.0:1788925253.965005:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470830976 00000100:00100000:3.0:1788925253.965062:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788925253.965071:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:24132:x1875823470830976:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925253.965082:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925253.965095:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f07800/0x45e32cfaf7423cd4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423ccd expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.965115:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f07800/0x45e32cfaf7423cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423ccd expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.965125:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f07800/0x45e32cfaf7423cd4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423ccd expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925253.965132:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f07800, rc 0) 00000100:00100000:3.0:1788925253.965166:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470830976:12345-0@lo:101:mount.lustre.0 Request processed in 97us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.965173:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788925253.966159:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470830976:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788925253.966179:0:24132:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cd4 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925253.966202:0:24132:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423cd4 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788925253.969260:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788925253.969584:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788925253.969790:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788925253.969815:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788925253.969829:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788925253.969840:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788925253.969854:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788925253.969964:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788925253.969980:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788925253.970072:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788925253.970089:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788925253.970101:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788925253.970115:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788925253.970128:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788925253.970140:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788925253.970152:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788925253.970163:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788925253.970173:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788925253.970198:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788925253.970213:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788925253.970224:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788925253.970236:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788925253.970248:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788925253.970258:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788925253.970269:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788925253.970281:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788925253.970295:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788925253.970309:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788925253.970335:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788925253.970348:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788925253.970360:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788925253.970372:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788925253.970385:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788925253.970399:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788925253.970452:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788925253.970469:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788925253.970481:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788925253.970493:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788925253.970506:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788925253.970518:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788925253.970528:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788925253.970539:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788925253.970550:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788925253.970561:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788925253.970573:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788925253.970586:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788925253.970598:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788925253.970610:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788925253.970622:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788925253.970632:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788925253.970759:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788925253.970781:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788925253.970797:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788925253.970803:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788925253.970914:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831104:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925253.970978:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925253.974216:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a3409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925253.984425:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831104 00000100:00100000:3.0:1788925253.984439:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831104 00000100:00100000:3.0:1788925253.984493:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788925253.984503:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925253.984668:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831104:12345-0@lo:501:mount.lustre.0 Request processed in 165us (13689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925253.984685:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788925253.986046:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831104:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925253.986103:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831232:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788925253.986158:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925253.994271:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6358276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925253.994337:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831232 00000100:00100000:0.0:1788925253.994347:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831232 00000100:00100000:0.0:1788925253.994391:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788925253.994442:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831232:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788925253.994575:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831232:12345-0@lo:503:mount.lustre.0 Request processed in 135us (8416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925253.994582:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788925253.997740:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831232:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788925253.998208:0:24132:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925253.998303:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925253.998368:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925253.998425:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6358276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925254.004303:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831360 00000100:00100000:3.0:1788925254.004317:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831360 00000100:00100000:3.0:1788925254.004376:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788925254.004385:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831360:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925254.004568:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831360:12345-0@lo:502:mount.lustre.0 Request processed in 184us (6200us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925254.004576:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788925254.006162:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831360:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925254.006442:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788925254.006473:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788925254.006486:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788925254.006500:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788925254.006515:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788925254.006528:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788925254.006541:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788925254.006554:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788925254.006568:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788925254.006582:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788925254.006595:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788925254.006610:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788925254.006625:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788925254.006639:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788925254.006651:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788925254.006666:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788925254.006698:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788925254.006715:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788925254.006727:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788925254.006750:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788925254.006762:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788925254.006773:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788925254.006785:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788925254.006799:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788925254.006812:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788925254.006824:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788925254.006836:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788925254.006854:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788925254.006868:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788925254.006879:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788925254.006891:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788925254.006917:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788925254.006944:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788925254.006958:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788925254.006970:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788925254.006982:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788925254.009328:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788925254.009363:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788925254.009379:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788925254.009391:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788925254.010090:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788925254.010119:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788925254.010136:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788925254.010153:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788925254.010170:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788925254.010187:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788925254.010204:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788925254.010220:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788925254.010302:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831488:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925254.010377:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925254.010496:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925254.015812:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831488 00000100:00100000:0.0:1788925254.015824:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831488 00000100:00100000:0.0:1788925254.015888:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788925254.015897:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831488:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925254.016553:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831488:12345-0@lo:502:mount.lustre.0 Request processed in 656us (6175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.016575:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788925254.016720:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831488:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925254.016948:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788925254.016977:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788925254.017026:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831616:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925254.017072:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925254.017114:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925254.017360:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831616 00000100:00100000:0.0:1788925254.017366:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831616 00000100:00100000:0.0:1788925254.017431:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788925254.017440:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831616:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925254.017528:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470831616:12345-0@lo:502:mount.lustre.0 Request processed in 88us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.017536:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788925254.021246:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470831616:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925254.021340:0:24132:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788925254.021354:0:24132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788925254.022956:0:24158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788925254.022972:0:24158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff97a607663380) 00000020:00000080:0.0:1788925254.023000:0:24158:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788925254.023072:0:24158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a503a1e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788925254.023076:0:24158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a503a1e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788925254.023078:0:24158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a503a1e000 3 00010000:00080000:0.0:1788925254.023107:0:24158:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a610e85800@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1788925254.024752:0:24158:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:0.0:1788925254.024950:0:24158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788925254.024996:0:24158:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788925254.025007:0:24158:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x45e32cfaf7423ce2 00000100:00080000:0.0:1788925254.025016:0:24158:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925254.025025:0:24158:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff97a610e85800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925254.025068:0:24158:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e351180 x1875823470831744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788925254.025093:0:24158:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788925254.026210:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470831744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788925254.026275:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788925254.029433:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.029439:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.029442:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.029445:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.029465:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.029468:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.029470:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.029473:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788925254.029507:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470831872:0@lo:400:kworker.0 00000100:00100000:3.0:1788925254.029562:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.029694:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470832000:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.029725:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.029767:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470832256:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.029787:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.029802:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788925254.029807:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470832128:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.029835:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831744 00000100:00100000:1.0:1788925254.029851:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831744 00000100:00100000:1.0:1788925254.029882:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832000 00000100:00100000:1.0:1788925254.029886:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832000 00000100:00100000:1.0:1788925254.029920:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832256 00000100:00100000:1.0:1788925254.029922:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832256 00000100:00100000:1.0:1788925254.029938:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925254.029945:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470832000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.030199:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470832000:12345-0@lo:400:kworker.0 Request processed in 253us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.030207:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925254.030225:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925254.030232:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470832256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.030278:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470832256:12345-0@lo:400:kworker.0 Request processed in 47us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.030284:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925254.030296:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925254.030300:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875823470831744:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788925254.030320:0:22633:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:1.0:1788925254.030351:0:22633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x45e32cfaf7423ce9 00000004:00100000:1.0:1788925254.030364:0:22633:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788925254.030394:0:22633:0:(import.c:65:import_set_state_nolock()) ffff97a5035b8000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925254.030767:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3620:x1875823470831744:12345-0@lo:38:llog_process_th.0 Request processed in 465us (4491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.030775:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788925254.030817:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e359880 x1875823470832000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925254.030831:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470832000:0@lo:400:kworker.0 00010000:00080000:1.0:1788925254.030961:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e351180 x1875823470831744/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925254.030969:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925254.030975:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788925254.030981:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788925254.030986:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788925254.031062:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e85800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788925254.031069:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3620:1875823470831744:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788925254.031532:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470831872 00000100:00100000:3.0:1788925254.031539:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470831872 00000100:00100000:3.0:1788925254.031654:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925254.031662:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470831872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925254.031707:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470831872:12345-0@lo:400:kworker.0 Request processed in 47us (2144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925254.031714:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925254.031742:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470831872:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.031811:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788925254.031850:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e358380 x1875823470832256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925254.031869:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470832256:0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.031892:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832128 00000100:00100000:1.0:1788925254.031895:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832128 00000100:00100000:1.0:1788925254.031927:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788925254.031933:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470832128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925254.031964:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470832128:12345-0@lo:400:kworker.0 Request processed in 31us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.031970:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788925254.032306:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470832128:0@lo:400:kworker.0 00000020:01000004:0.0:1788925254.033824:0:24158:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788925254.033841:0:24158:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff97a607660000) 00000020:00000080:0.0:1788925254.035444:0:24158:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:0.0:1788925254.035588:0:24158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a503a1e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788925254.035594:0:24158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a503a1e000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788925254.035596:0:24158:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a503a1e000 3 00010000:00080000:0.0:1788925254.035629:0:24158:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a610e85000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.151@tcp at head 00010000:00010000:0.0:1788925254.040801:0:24158:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:0.0:1788925254.042934:0:24158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:0.0:1788925254.043525:0:24158:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788925254.043539:0:24158:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x45e32cfaf7423cf7 00000100:00080000:0.0:1788925254.043550:0:24158:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788925254.043562:0:24158:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff97a610e85000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:0.0:1788925254.043970:0:24158:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a62e353100 x1875823470832384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925254.044675:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1875823470832384:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788925254.044744:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925254.044799:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832384 00000100:00100000:0.0:1788925254.044805:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832384 00000100:00100000:0.0:1788925254.044832:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925254.044839:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3620:x1875823470832384:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788925254.045955:0:22633:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 640 last 0 00000020:00000080:0.0:1788925254.046257:0:22633:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x45e32cfaf7423cfe 00000004:00100000:0.0:1788925254.046273:0:22633:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788925254.046304:0:22633:0:(import.c:65:import_set_state_nolock()) ffff97a608b34800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925254.046370:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1875823470832384:12345-0@lo:38:llog_process_th.0 Request processed in 1529us (1625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.046379:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788925254.050475:0:24158:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788925254.050502:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.050507:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.050510:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.050513:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.050517:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.050520:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788925254.050522:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925254.050524:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788925254.051192:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff97a62e353100 x1875823470832384/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925254.051208:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925254.051217:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788925254.051226:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788925254.051232:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788925254.051235:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e85000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788925254.051241:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3620:1875823470832384:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788925254.051804:0:24158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788925254.052800:0:24132:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788925254.052832:0:24132:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788925254.052848:0:24132:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cd4 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925254.053081:0:24132:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858c600/0x45e32cfaf7423ccd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423cd4 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788925254.053129:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788925254.053131:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788925254.053133:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925254.053134:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925254.053135:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925254.053137:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925254.053138:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925254.053140:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925254.053141:0:24132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925254.053144:0:24132:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788925254.053147:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788925254.053148:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788925254.053149:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925254.053150:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925254.053151:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925254.053152:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925254.053153:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925254.053154:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925254.053156:0:24132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925254.053179:0:24132:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788925254.053195:0:24132:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470832512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788925254.053256:0:24132:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925254.053287:0:24132:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635827840 going to sleep for 11 seconds 00000100:00100000:0.0:1788925254.053737:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832512 00000100:00100000:0.0:1788925254.053745:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832512 00000100:00100000:0.0:1788925254.053790:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788925254.053799:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470832512:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788925254.053825:0:22626:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788925254.053840:0:22626:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788925254.076223:0:22626:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788925254.076239:0:22626:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788925254.076703:0:22648:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788925254.076709:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788925254.076730:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.076746:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 21 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.076753:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 21 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.076771:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.076803:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 21 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.076816:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 21 pid: 22625 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925254.076829:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470832640:0@lo:104: 00000100:00100000:3.0:1788925254.076957:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925254.077124:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 21 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.077132:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 21 pid: 22626 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925254.077140:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470832768:0@lo:104: 00000100:00100000:3.0:1788925254.077167:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925254.077182:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d36c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925254.078738:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24132:x1875823470832512:12345-0@lo:253:mount.lustre.0 Request processed in 24933us (25475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925254.078751:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788925254.078912:0:22617:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788925254.078966:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832640 00000100:00100000:0.0:1788925254.078975:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832640 00000100:00100000:0.0:1788925254.079004:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832768 00000100:00100000:0.0:1788925254.079007:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832768 00000100:00100000:0.0:1788925254.079027:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925254.079034:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470832640:12345-0@lo:104: 00010000:00010000:0.0:1788925254.079048:0:22617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079126:0:22617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788925254.079132:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470832640:12345-0@lo:104: Request processed in 98us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.079138:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925254.079151:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925254.079157:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470832768:12345-0@lo:104: 00010000:00010000:0.0:1788925254.079164:0:22617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079196:0:22617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788925254.079202:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c57c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470832768:12345-0@lo:104: Request processed in 46us (2034us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.079207:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1788925254.079244:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925254.079250:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079257:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437600 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925254.079261:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079270:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925254.079287:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925254.079293:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925254.079324:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079330:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925254.079348:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079355:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c437600/0x45e32cfaf7423c56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c5d expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079366:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925254.079369:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079375:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437000 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925254.079377:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079384:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925254.079389:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925254.079394:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925254.079448:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079454:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925254.079460:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079465:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c4f expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079478:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925254.079480:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925254.079481:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925254.079502:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470832896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925254.079535:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925254.079561:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925254.079567:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470833024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925254.079590:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925254.079683:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470832896 00000100:00100000:0.0:1788925254.079687:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470832896 00010000:00010000:0.0:1788925254.079705:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 21 pid: 22625 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925254.079725:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833024 00000100:00100000:0.0:1788925254.079728:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833024 00010000:00010000:0.0:1788925254.079738:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 22 pid: 22626 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925254.079749:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925254.079754:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+22:3623:x1875823470832896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925254.079772:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925254.079777:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 22 pid: 22625 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079786:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 22 pid: 22625 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079800:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925254.079828:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+22:3623:x1875823470832896:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.079833:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925254.079846:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925254.079852:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+21:3623:x1875823470833024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925254.079860:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925254.079863:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 21 pid: 22626 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079871:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 21 pid: 22626 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079882:0:22619:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079890:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925254.079913:0:22619:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003205407s 00010000:00010000:0.0:1788925254.079917:0:22619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079933:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079939:0:22619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079945:0:22619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079950:0:22619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925254.079954:0:22619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079961:0:22619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079969:0:22619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925254.079978:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925254.079999:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef23450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+21:3623:x1875823470833024:12345-0@lo:103:ldlm_bl.0 Request processed in 148us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925254.080005:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925254.080055:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470833024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925254.080062:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470832896:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925254.080306:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a61858ce00/0x45e32cfaf7423c5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c56 expref: 20 pid: 22625 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925254.080318:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831500 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470832640:0@lo:104: 00010000:00010000:3.0:1788925254.080327:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f07200/0x45e32cfaf7423c4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c48 expref: 19 pid: 22626 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925254.080333:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470832768:0@lo:104: 00010000:00010000:3.0:1788925254.080354:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.080362:0:22648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.080367:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925254.080373:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d05 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925254.080448:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925254.082965:0:24132:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24132:1875823470832512:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788925254.082987:0:24132:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788925254.083059:0:24132:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788925254.083060:0:24132:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788925254.083062:0:24132:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788925254.083063:0:24132:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788925254.083064:0:24132:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788925254.083065:0:24132:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788925254.083066:0:24132:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788925254.083068:0:24132:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788925254.083069:0:24132:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788925254.083083:0:24132:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788925254.088470:0:24132:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:2.0:1788925254.090964:0:24132:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788925254.090973:0:24132:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788925254.091018:0:24132:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788925254.091056:0:24132:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788925254.091074:0:24132:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788925254.091090:0:24132:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:2.0:1788925254.094854:0:24132:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788925254.095091:0:24132:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:2.0:1788925254.251470:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788925254.898216:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788925255.146542:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925255.146551:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a503ad9800 from 13 10000000:01000000:0.0:1788925255.146573:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925255.146620:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.146632:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.146643:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925255.146669:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925255.146737:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925255.146786:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788925255.146945:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833152 00000100:00100000:3.0:1788925255.146953:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833152 00000100:00100000:3.0:1788925255.147004:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788925255.147012:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+19:22630:x1875823470833152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925255.147025:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925255.147038:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423d0c expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925255.147062:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 20 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925255.147072:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 20 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925255.147081:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f06400, rc 0) 00000100:00100000:3.0:1788925255.147125:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+20:22630:x1875823470833152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925255.147132:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788925255.147262:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925255.147275:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.147283:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925255.147339:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833280:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788925255.147367:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925255.147388:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925255.147447:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833280 00000100:00100000:1.0:1788925255.147456:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833280 00000100:00100000:1.0:1788925255.147487:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788925255.147501:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+20:22630:x1875823470833280:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788925255.147513:0:22626:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788925255.147527:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788925255.147530:0:22626:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788925255.147602:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+20:22630:x1875823470833280:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925255.147609:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788925255.147741:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833280:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788925255.147795:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788925255.147801:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.147817:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925255.147825:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925255.147827:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a62e331000 from 13 10000000:01000000:0.0:1788925255.147830:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925255.147846:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.147854:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925255.147861:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925255.147874:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925255.147911:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925255.147938:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60abe3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788925255.147987:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833408 00000100:00100000:1.0:1788925255.147992:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833408 00000100:00100000:1.0:1788925255.148025:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788925255.148032:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+20:22630:x1875823470833408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925255.148040:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925255.148049:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423d1a expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925255.148063:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925255.148072:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 21 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925255.148079:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c437a00, rc 0) 00000100:00100000:1.0:1788925255.148120:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470833408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925255.148126:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788925255.148242:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925255.148253:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925255.148261:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925255.148303:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833536:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788925255.148343:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925255.148365:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618229780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925255.148484:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833536 00000100:00100000:3.0:1788925255.148488:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833536 00000100:00100000:3.0:1788925255.148530:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788925255.148538:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470833536:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788925255.148551:0:22625:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788925255.148566:0:22625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788925255.148569:0:22625:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:3.0:1788925255.148647:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470833536:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925255.148654:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788925255.148812:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470833536:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788925255.148857:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925255.148862:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925255.148869:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:3.0:1788925255.442866:0:24211:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788925255.443307:0:24211:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788925255.915633:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925256.939200:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925257.387768:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925257.387798:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470833664:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925257.387900:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925257.387965:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833664 00000100:00100000:3.0:1788925257.387975:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833664 00000100:00100000:3.0:1788925257.388032:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925257.388046:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470833664:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788925257.388090:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925257.388146:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470833664:12345-0@lo:41:osp-pre-0-1.0 Request processed in 102us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925257.388154:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925257.388216:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470833664:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925257.898971:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925257.899015:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470833792:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788925257.899117:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925257.899213:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833792 00000100:00100000:3.0:1788925257.899224:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833792 00000100:00100000:3.0:1788925257.899285:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788925257.899298:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470833792:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788925257.899366:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788925257.899477:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470833792:12345-0@lo:41:osp-pre-1-0.0 Request processed in 181us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925257.899485:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788925257.899957:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470833792:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788925257.962696:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925258.986508:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925259.446978:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470833920:0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.447046:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.447613:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470834048:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.447651:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.447697:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834048 00000100:00100000:0.0:1788925259.447704:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834048 00000100:00100000:0.0:1788925259.447760:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925259.447769:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470834048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.447820:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470834048:12345-0@lo:400:kworker.0 Request processed in 52us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925259.447833:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925259.447881:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470834048:0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.452161:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470833920 00000100:00100000:1.0:1788925259.452174:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470833920 00000100:00100000:1.0:1788925259.452229:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788925259.452238:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:3623:x1875823470833920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925259.452317:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:3623:x1875823470833920:12345-0@lo:400:kworker.0 Request processed in 81us (5272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925259.452325:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788925259.452695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925259.452700:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925259.452703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925259.452706:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925259.452766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925259.452770:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788925259.452772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925259.452775:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788925259.452823:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470834560:0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.452882:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925259.452911:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925259.452917:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470834432:0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.452940:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925259.452970:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834560 00000100:00100000:2.0:1788925259.452975:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834560 00000100:00100000:2.0:1788925259.453011:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834432 00000100:00100000:2.0:1788925259.453014:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834432 00000100:00100000:2.0:1788925259.453045:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788925259.453053:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470834560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.453089:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470834560:12345-0@lo:400:kworker.0 Request processed in 38us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925259.453095:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788925259.453110:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925259.453115:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875823470834432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.453142:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875823470834432:12345-0@lo:400:kworker.0 Request processed in 27us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925259.453148:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788925259.453185:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a63c71d500 x1875823470834432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925259.453198:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875823470834432:0@lo:400:kworker.0 00010000:00080000:2.0:1788925259.453209:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a63c71c000 x1875823470834560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925259.453216:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470834560:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.453460:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470834176:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.453490:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.453509:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470834688:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.453529:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.453544:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925259.453548:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470834304:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.453571:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925259.453599:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834304 00000100:00100000:0.0:1788925259.453603:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834304 00000100:00100000:0.0:1788925259.453631:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925259.453637:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470834304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.453674:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470834304:12345-0@lo:400:kworker.0 Request processed in 37us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925259.453680:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925259.453710:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470834304:0@lo:400:kworker.0 00000100:00100000:0.0:1788925259.454482:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470833920:0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.455132:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834176 00000100:00100000:2.0:1788925259.455147:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834176 00000100:00100000:2.0:1788925259.455188:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834688 00000100:00100000:2.0:1788925259.455192:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834688 00000100:00100000:2.0:1788925259.455217:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788925259.455224:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470834176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.455281:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470834176:12345-0@lo:400:kworker.0 Request processed in 58us (1790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925259.455288:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788925259.455301:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788925259.455308:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470834688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925259.455333:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470834688:12345-0@lo:400:kworker.0 Request processed in 27us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925259.455339:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788925259.455375:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a63c71d880 x1875823470834176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925259.455386:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470834176:0@lo:400:kworker.0 00010000:00080000:2.0:1788925259.455429:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5041ce680 x1875823470834688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925275 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925259.455439:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470834688:0@lo:400:kworker.0 00000100:00080000:1.0:1788925259.456265:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788925259.456271:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1788925259.566018:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788925260.011757:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925261.034594:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925261.227564:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925246/real 1788925246] req@ffff97a63c71ea00 x1875823470827392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925261.227594:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a63c71ea00 x1875823470827392/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925261.227604:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925246/real 1788925246] req@ffff97a63c71ed80 x1875823470827520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925261 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925261.227632:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a63c71ed80 x1875823470827520/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925261 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925261.227650:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a63f7cd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925261.227673:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788925261.227677:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470827392:0@lo:8:kworker.0 00000100:00080000:0.0:1788925261.227682:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925261.227686:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788925261.227689:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470827520:0@lo:8:kworker.0 00000100:00080000:1.0:1788925261.228766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925261.228771:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925261.228773:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925261.228776:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925261.228790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925261.228793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788925261.228795:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a63f7cd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925261.228801:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788925261.228806:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788925261.228816:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff97a63f7cd800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925261.228833:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a501f2a300 x1875823470835328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788925261.228846:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925261.228854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788925261.228856:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925261.228859:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 632 00000100:00080000:1.0:1788925261.228874:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788925261.228879:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925261.228892:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a501f2aa00 x1875823470835456/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925261.228941:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470835200:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.228992:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229021:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925261.229027:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470834816:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229049:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229071:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470835584:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229090:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229110:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470834944:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229127:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229141:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1875823470835712:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229155:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229168:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788925261.229172:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470835072:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229187:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229199:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470835840:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229216:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925261.229239:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835200 00000100:00100000:1.0:1788925261.229245:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835200 00000100:00100000:1.0:1788925261.229281:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834944 00000100:00100000:1.0:1788925261.229283:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834944 00000100:00100000:1.0:1788925261.229295:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925261.229302:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470835200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.229348:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470835200:12345-0@lo:400:kworker.0 Request processed in 46us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925261.229354:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925261.229369:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925261.229374:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470834944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.232669:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835584 00000100:00100000:3.0:1788925261.232683:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835584 00000100:00100000:3.0:1788925261.232722:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835712 00000100:00100000:3.0:1788925261.232725:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835712 00000100:00100000:3.0:1788925261.232753:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835072 00000100:00100000:3.0:1788925261.232756:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835072 00000100:00100000:3.0:1788925261.232766:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835840 00000100:00100000:3.0:1788925261.232769:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835840 00000100:00100000:3.0:1788925261.232785:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925261.232794:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470835584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.232880:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470835584:12345-0@lo:400:kworker.0 Request processed in 87us (3788us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.232887:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788925261.232903:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925261.232909:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875823470835712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.232934:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875823470835712:12345-0@lo:400:kworker.0 Request processed in 26us (3778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.232939:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788925261.232947:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925261.232953:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470835072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.232978:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470835072:12345-0@lo:400:kworker.0 Request processed in 25us (3790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.232984:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925261.233001:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925261.233006:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470835840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.233032:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470835840:12345-0@lo:400:kworker.0 Request processed in 26us (3814us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.233038:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788925261.233064:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470834816 00000100:00100000:3.0:1788925261.233067:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470834816 00000100:00100000:1.0:1788925261.233117:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470834944:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925261.233127:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1788925261.233177:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f29c00 x1875823470835584/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925261.233191:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470835584:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.233204:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470835200:0@lo:400:kworker.0 00010000:00080000:1.0:1788925261.233233:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2b800 x1875823470835072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925261.233243:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470835072:0@lo:400:kworker.0 00010000:00080000:1.0:1788925261.233253:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2ad80 x1875823470835840/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925261.233260:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470835840:0@lo:400:kworker.0 00000100:00100000:1.0:1788925261.233270:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470834944:0@lo:400:kworker.0 00010000:00080000:1.0:1788925261.233279:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f28000 x1875823470835712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925261.233294:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1875823470835712:0@lo:400:kworker.0 00000100:00080000:0.0:1788925261.233376:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925261.233380:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925261.234235:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788925261.234249:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:3621:x1875823470834816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.234350:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:3621:x1875823470834816:12345-0@lo:400:kworker.0 Request processed in 106us (5299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.234357:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788925261.234392:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470835328:0@lo:8:kworker.0 00000100:00100000:3.0:1788925261.234452:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925261.234485:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470835456:0@lo:8:kworker.0 00000100:00100000:3.0:1788925261.234525:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925261.234565:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835328 00000100:00100000:3.0:1788925261.234571:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835328 00000100:00100000:3.0:1788925261.234587:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835456 00000100:00100000:3.0:1788925261.234590:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835456 00000100:00100000:3.0:1788925261.234599:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925261.234603:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1875823470835328:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788925261.234642:0:24137:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 647 last 0 00000020:00000080:3.0:1788925261.234668:0:24137:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423d28 00002000:00100000:3.0:1788925261.234680:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff97a503838800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788925261.234685:0:24137:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788925261.234692:0:24137:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788925261.234846:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788925261.234883:0:24137:0:(import.c:65:import_set_state_nolock()) ffff97a50383d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925261.234920:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3620:x1875823470835328:12345-0@lo:8:kworker.0 Request processed in 315us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.234927:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925261.234939:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788925261.234944:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1875823470835456:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788925261.234955:0:24137:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925261.234976:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3620:x1875823470835456:12345-0@lo:8:kworker.0 Request processed in 31us (452us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925261.234982:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788925261.235011:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2a300 x1875823470835328/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925281 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925261.235019:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925261.235025:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1788925261.235032:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788925261.235037:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788925261.235039:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a63f7cd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788925261.235049:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788925261.235054:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470835328:0@lo:8:kworker.0 00000100:00080000:3.0:1788925261.235064:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925261.235067:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788925261.235070:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470835456:0@lo:8:kworker.0 00000004:00080000:3.0:1788925261.235114:0:23374:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788925261.235130:0:23374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836096:0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788925261.235159:0:23374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925261.235173:0:23374:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6358276c0 going to sleep for 11 seconds 00000004:00080000:3.0:1788925261.235186:0:23373:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788925261.235237:0:23373:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 647400834346ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788925261.235243:0:23373:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788925261.235262:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788925261.235271:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470835968:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788925261.235296:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925261.235318:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836096 00000100:00100000:3.0:1788925261.235322:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836096 00000100:00100000:3.0:1788925261.235349:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925261.235354:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23374:x1875823470836096:12345-0@lo:7:osp-pre-0-1.0 00000100:00080000:3.0:1788925261.235544:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788925261.245748:0:24137:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1788925261.245760:0:24137:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1788925261.245840:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23374:x1875823470836096:12345-0@lo:7:osp-pre-0-1.0 Request processed in 10482us (10676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925261.245853:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925261.246741:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470835968 00000100:00100000:1.0:1788925261.246750:0:24140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470835968 00000004:00080000:3.0:1788925261.246847:0:23364:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00010000:00080000:3.0:1788925261.246916:0:23374:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502832d80 x1875823470836096/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925261.246930:0:23374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836096:0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788925261.246942:0:23374:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:3.0:1788925261.246989:0:23374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836224:0@lo:5:osp-pre-0-1.0 00000100:00100000:3.0:1788925261.247026:0:23374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925261.247048:0:23374:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6358276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925261.247071:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836224 00000100:00100000:3.0:1788925261.247075:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836224 00000100:00100000:3.0:1788925261.247101:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788925261.247110:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23374:x1875823470836224:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788925261.247132:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:3.0:1788925261.247163:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23374:x1875823470836224:12345-0@lo:5:osp-pre-0-1.0 Request processed in 55us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.247181:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788925261.247208:0:23374:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502832d80 x1875823470836224/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925277 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925261.247218:0:23374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836224:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788925261.247225:0:23374:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788925261.251493:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470834816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925261.257708:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788925261.257726:0:24140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875823470835968:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788925261.257758:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788925261.257838:0:24140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3622:x1875823470835968:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (22540us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925261.257845:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788925261.258353:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502832680 x1875823470835968/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925277 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925261.258374:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470835968:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1788925261.728377:0:24502:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788925262.058713:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925262.506673:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925262.506695:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470836352:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925262.506759:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925262.506876:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836352 00000100:00100000:3.0:1788925262.506884:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836352 00000100:00100000:3.0:1788925262.506931:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788925262.506940:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470836352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788925262.506974:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925262.507027:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470836352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925262.507034:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788925262.507173:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470836352:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788925262.940358:0:24554:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788925262.940685:0:24554:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788925263.030310:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470836480:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788925263.030387:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925263.030586:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836480 00000100:00100000:3.0:1788925263.030594:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836480 00000100:00100000:3.0:1788925263.030643:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788925263.030652:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470836480:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788925263.030680:0:22638:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788925263.030750:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470836480:12345-0@lo:41:osp-pre-1-0.0 Request processed in 98us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925263.030757:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788925263.030801:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470836480:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788925263.083925:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925264.111720:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788925264.493445:0:24604:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788925264.493657:0:24604:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:3.0:1788925264.521437:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788925265.131256:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925266.156042:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925266.605700:0:23374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836736:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1788925266.605789:0:23374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.605855:0:23374:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a3246c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788925266.605905:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925266.605909:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925266.605912:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925266.605915:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788925266.605928:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788925266.605931:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788925266.605935:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788925266.605941:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 647 00000100:00080000:1.0:1788925266.605956:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788925266.605967:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:1.0:1788925266.605994:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a501f29500 x1875823470837376/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925266.606046:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470836608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925266.606075:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.606099:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470837248:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606129:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925266.606154:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837248 00000100:00100000:1.0:1788925266.606157:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788925266.606164:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837248 00000100:00100000:1.0:1788925266.606165:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470837120:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606200:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925266.606222:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925266.606227:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470837760:0@lo:400:kworker.0 00000100:00100000:2.0:1788925266.606235:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470837248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606253:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.606295:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836736 00000100:00100000:1.0:1788925266.606300:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836736 00000100:00100000:2.0:1788925266.606311:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470837248:12345-0@lo:400:kworker.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925266.606320:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788925266.606355:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788925266.606364:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23374:x1875823470836736:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:1.0:1788925266.606425:0:24137:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000100:00100000:1.0:1788925266.606552:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470836864:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606588:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.606612:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470837504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606635:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.606654:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925266.606660:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470836992:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606682:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925266.606708:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470837632:0@lo:400:kworker.0 00000100:00100000:2.0:1788925266.606732:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836864 00000100:00100000:1.0:1788925266.606738:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925266.606740:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836864 00000100:00100000:2.0:1788925266.606780:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925266.606782:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470837376:0@lo:8:kworker.0 00000100:00100000:2.0:1788925266.606790:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:3621:x1875823470836864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.606853:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925266.606886:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:3621:x1875823470836864:12345-0@lo:400:kworker.0 Request processed in 45us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.606891:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836608 00000100:00100000:1.0:1788925266.606896:0:24140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836608 00000100:00100000:2.0:1788925266.606897:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788925266.606928:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925266.606935:0:24140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875823470836608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788925266.606951:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 896 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788925266.606983:0:24140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875823470836608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (907us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.606989:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925266.607009:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837120 00000100:00100000:1.0:1788925266.607012:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837120 00000100:00100000:1.0:1788925266.607029:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837760 00000100:00100000:1.0:1788925266.607032:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837760 00000100:00100000:1.0:1788925266.607047:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837504 00000100:00100000:1.0:1788925266.607050:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837504 00000100:00100000:1.0:1788925266.607060:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837632 00000100:00100000:1.0:1788925266.607062:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837632 00000100:00100000:1.0:1788925266.607076:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788925266.607082:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470837120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607111:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470837120:12345-0@lo:400:kworker.0 Request processed in 29us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.607117:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788925266.607130:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788925266.607136:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470837760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607162:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470837760:12345-0@lo:400:kworker.0 Request processed in 26us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.607173:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788925266.607186:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788925266.607191:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470837504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607225:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470837504:12345-0@lo:400:kworker.0 Request processed in 34us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.607232:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788925266.607245:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788925266.607251:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470837632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607276:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470837632:12345-0@lo:400:kworker.0 Request processed in 26us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.607281:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788925266.607303:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925266.607308:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788925266.607311:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925266.607321:0:24138:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788925266.607328:0:24138:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788925266.607359:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470836992 00000100:00100000:1.0:1788925266.607364:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470836992 00000100:00100000:1.0:1788925266.607387:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788925266.607394:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470836992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607451:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470836992:12345-0@lo:400:kworker.0 Request processed in 58us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925266.607457:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788925266.607480:0:24139:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788925266.607488:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837376 00000100:00100000:1.0:1788925266.607491:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837376 00000100:00100000:1.0:1788925266.607535:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470836992:0@lo:400:kworker.0 00010000:00080000:1.0:1788925266.607558:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2b800 x1875823470837632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.607568:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470837632:0@lo:400:kworker.0 00000100:00100000:1.0:1788925266.607577:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470836864:0@lo:400:kworker.0 00010000:00080000:1.0:1788925266.607587:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2ad80 x1875823470837504/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.607595:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470837504:0@lo:400:kworker.0 00010000:00080000:1.0:1788925266.607635:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f2a300 x1875823470837120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.607645:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470837120:0@lo:400:kworker.0 00010000:00080000:1.0:1788925266.607655:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a501f29180 x1875823470837760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.607662:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470837760:0@lo:400:kworker.0 00010000:00080000:1.0:1788925266.607672:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a62e358380 x1875823470836608/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.607687:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470836608:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925266.607700:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470837248:0@lo:400:kworker.0 00000100:00100000:2.0:1788925266.608271:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788925266.608278:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470837376:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788925266.608299:0:24673:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788925266.608361:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470837376:12345-0@lo:8:kworker.0 Request processed in 82us (1526us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788925266.608368:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788925266.612749:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788925266.612767:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788925266.612774:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470837376:0@lo:8:kworker.0 00000001:00100000:0.0:1788925266.620363:0:24133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:1.0:1788925266.644279:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23374:x1875823470836736:12345-0@lo:5:osp-pre-0-1.0 Request processed in 37908us (38482us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788925266.644294:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788925266.644602:0:23374:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a62e35bb80 x1875823470836736/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925266.644624:0:23374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e35bb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23374:1875823470836736:0@lo:5:osp-pre-0-1.0 00000004:00080000:3.0:1788925266.644643:0:23374:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:3.0:1788925266.644698:0:23374:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502833100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23374:1875823470837888:0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788925266.644743:0:23374:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925266.644770:0:23374:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a634f21240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925266.654756:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470837888 00000100:00100000:1.0:1788925266.654796:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470837888 00000100:00100000:1.0:1788925266.654890:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925266.654902:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23374:x1875823470837888:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788925266.665627:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23374:x1875823470837888:12345-0@lo:900:osp-pre-0-1.0 Request processed in 10714us (20871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925266.665652:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788925266.667732:0:23374:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502833100 x1875823470837888/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788925282 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925266.667755:0:23374:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502833100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23374:1875823470837888:0@lo:900:osp-pre-0-1.0 00010000:00010000:3.0:1788925267.180051:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925267.633840:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925247/real 1788925247] req@ffff97a62e350e00 x1875823470828160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925267 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.633892:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a62e350e00 x1875823470828160/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925267 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.633904:0:3620:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788925247/real 1788925247] req@ffff97a62e353480 x1875823470828288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925267 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.633934:0:3620:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff97a62e353480 x1875823470828288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788925267 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788925267.633956:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925267.633990:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788925267.634000:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470828160:0@lo:8:kworker.0 00000100:00080000:1.0:1788925267.634008:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925267.634014:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788925267.634017:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470828288:0@lo:8:kworker.0 00000100:00080000:3.0:1788925267.634098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925267.634103:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788925267.634106:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925267.634122:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1788925267.634128:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00100000:1.0:1788925267.634140:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470838016:0@lo:400:kworker.0 00000100:00080000:3.0:1788925267.634148:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff97a610e8a000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925267.634172:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a502830a80 x1875823470838272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925267.634185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925267.634189:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925267.634190:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925267.634194:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 633 00000100:00080000:3.0:1788925267.634196:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788925267.634201:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925267.634213:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a502830700 x1875823470838400/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925267.634240:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925267.634244:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925267.634245:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925267.634249:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 652 00000100:00080000:3.0:1788925267.634251:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788925267.634255:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925267.634267:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a502832d80 x1875823470838912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925267.634420:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634486:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470838784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.634542:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634580:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788925267.634587:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470838656:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.634707:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634738:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470839296:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.634788:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634865:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470838144:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.634911:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634929:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470839040:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.634962:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.634990:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788925267.634995:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470838528:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.635018:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.635036:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470839168:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.635076:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.635120:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470838272:0@lo:8:kworker.0 00000100:00100000:1.0:1788925267.635148:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.635172:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470838400:0@lo:8:kworker.0 00000100:00100000:3.0:1788925267.635790:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838016 00000100:00100000:3.0:1788925267.635800:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838016 00000100:00100000:3.0:1788925267.635874:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788925267.635885:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:3624:x1875823470838016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925267.635974:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:3624:x1875823470838016:12345-0@lo:400:kworker.0 Request processed in 91us (1553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.635993:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788925267.636499:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.636553:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470838912:0@lo:8:kworker.0 00000100:00100000:1.0:1788925267.636604:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.636939:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838784 00000100:00100000:1.0:1788925267.636946:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838784 00000100:00100000:1.0:1788925267.636982:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838272 00000100:00100000:1.0:1788925267.636986:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838272 00000100:00100000:3.0:1788925267.637019:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838400 00000100:00100000:3.0:1788925267.637023:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838400 00000100:00100000:1.0:1788925267.637024:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838912 00000100:00100000:1.0:1788925267.637026:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838912 00000100:00100000:1.0:1788925267.637036:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925267.637389:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1875823470838784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.637488:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3624:x1875823470838784:12345-0@lo:400:kworker.0 Request processed in 444us (2944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.637757:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839296 00000100:00100000:0.0:1788925267.637764:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839296 00000100:00100000:0.0:1788925267.637810:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839040 00000100:00100000:0.0:1788925267.637813:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839040 00000100:00100000:0.0:1788925267.637841:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838528 00000100:00100000:0.0:1788925267.637845:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838528 00000100:00100000:0.0:1788925267.637860:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839168 00000100:00100000:0.0:1788925267.637862:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839168 00000100:00100000:0.0:1788925267.637886:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925267.637913:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470839296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.637959:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470839296:12345-0@lo:400:kworker.0 Request processed in 67us (3170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.637967:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788925267.638002:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925267.638008:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470839040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.638045:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e358380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470839040:12345-0@lo:400:kworker.0 Request processed in 38us (3082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.638069:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925267.638082:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925267.638088:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470838528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.638118:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470838528:12345-0@lo:400:kworker.0 Request processed in 31us (3099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.638123:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788925267.638134:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925267.638140:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470839168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.638168:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470839168:12345-0@lo:400:kworker.0 Request processed in 29us (3091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.638183:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788925267.638878:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838656 00000100:00100000:0.0:1788925267.638886:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838656 00000100:00100000:0.0:1788925267.638922:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470838144 00000100:00100000:0.0:1788925267.638925:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470838144 00000100:00100000:0.0:1788925267.638939:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925267.638945:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470838656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.638994:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470838656:12345-0@lo:400:kworker.0 Request processed in 50us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.639000:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925267.639012:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925267.639038:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470838144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925267.639067:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470838144:12345-0@lo:400:kworker.0 Request processed in 50us (4156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.639080:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788925267.641961:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925267.641976:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470838272:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788925267.642018:0:24673:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 653 last 0 00000020:00000080:3.0:1788925267.642052:0:24673:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423d2f 00002000:00100000:3.0:1788925267.642072:0:24673:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff97a50383c000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1788925267.642077:0:24673:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1788925267.642081:0:24673:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788925267.642163:0:24673:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788925267.642193:0:24673:0:(import.c:65:import_set_state_nolock()) ffff97a50383a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925267.642293:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3620:x1875823470838272:12345-0@lo:8:kworker.0 Request processed in 320us (7144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.642301:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925267.642334:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925267.642338:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470838400:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788925267.642350:0:24673:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925267.642372:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470838400:12345-0@lo:8:kworker.0 Request processed in 32us (5873us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925267.642377:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788925267.642388:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788925267.642392:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470838912:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788925267.642422:0:24673:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788925267.642454:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3620:x1875823470838912:12345-0@lo:8:kworker.0 Request processed in 60us (5850us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788925267.642459:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925267.643375:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788925267.643453:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470839424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925267.643513:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925267.643824:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470838656:0@lo:400:kworker.0 00010000:00080000:1.0:1788925267.643858:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010ad500 x1875823470839296/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.643869:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470839296:0@lo:400:kworker.0 00010000:00080000:1.0:1788925267.643880:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502833100 x1875823470838784/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.643888:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502833100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470838784:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.643899:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470838016:0@lo:400:kworker.0 00010000:00080000:1.0:1788925267.643956:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502831880 x1875823470838528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.643965:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470838528:0@lo:400:kworker.0 00010000:00080000:1.0:1788925267.643975:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502830e00 x1875823470839168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.643982:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470839168:0@lo:400:kworker.0 00000100:00100000:1.0:1788925267.644004:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470838144:0@lo:400:kworker.0 00010000:00080000:1.0:1788925267.644016:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502832680 x1875823470839040/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.644023:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470839040:0@lo:400:kworker.0 00000100:00100000:3.0:1788925267.644151:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839424 00000100:00100000:3.0:1788925267.644159:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839424 00000100:00100000:3.0:1788925267.644203:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788925267.644215:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470839424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788925267.644268:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925267.644318:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470839424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925267.644326:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:1.0:1788925267.644391:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a502830a80 x1875823470838272/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.644910:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788925267.644921:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788925267.644930:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788925267.644937:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788925267.644940:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a610e8a000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788925267.644955:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788925267.644961:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470838272:0@lo:8:kworker.0 00000100:00080000:1.0:1788925267.644978:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925267.644982:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925267.644985:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470838400:0@lo:8:kworker.0 00000100:00080000:1.0:1788925267.644995:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925267.644998:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925267.645000:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502832d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470838912:0@lo:8:kworker.0 00000100:00100000:1.0:1788925267.645040:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470839424:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925267.645141:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470839552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925267.645178:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788925267.645221:0:22657:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788925267.645243:0:22657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22657:1875823470839680:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788925267.645386:0:22657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925267.645672:0:22657:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6184a5a80 going to sleep for 11 seconds 00000004:00080000:3.0:1788925267.645689:0:22656:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788925267.645790:0:22656:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 653811387551ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788925267.645796:0:22656:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788925267.646074:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839680 00000100:00100000:3.0:1788925267.646082:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839680 00000100:00100000:3.0:1788925267.646134:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925267.646142:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22657:x1875823470839680:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788925267.646661:0:24140:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839552 00000100:00100000:1.0:1788925267.646672:0:24140:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839552 00000100:00100000:1.0:1788925267.646739:0:24140:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788925267.646746:0:24140:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875823470839552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788925267.646761:0:24140:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788925267.646823:0:24140:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3621:x1875823470839552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925267.646840:0:24140:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788925267.646896:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788925267.646926:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010ad180 x1875823470839552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925283 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925267.646943:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470839552:0@lo:13:osp-pre-0-0.0 00000004:00080000:3.0:1788925267.656071:0:22612:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788925267.668076:0:24673:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788925267.668091:0:24673:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788925267.668098:0:24673:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:3.0:1788925267.680371:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925267.680395:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.680463:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=653s v=(0 0) 00010000:00010000:3.0:1788925267.680468:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925267.680492:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.680515:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.680534:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.680544:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.680585:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925267.680809:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.680820:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.680839:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.680845:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.680854:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.680878:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.680898:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6a09ec3/0x45e32cfaf7423d36 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.680919:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.680922:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.680924:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925267.683551:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925267.683580:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.683602:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=653s v=(0 0) 00010000:00010000:3.0:1788925267.683607:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925267.683639:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.683656:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.683690:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.683699:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.683745:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788925267.684920:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925267.684947:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.684968:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=653s v=(0 0) 00010000:00010000:3.0:1788925267.684972:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925267.684977:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.685004:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.685014:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.685022:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.685083:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788925267.685229:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925267.685237:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685257:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.685263:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685274:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685295:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685303:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cf6fc9bc/0x45e32cfaf7423d3d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685331:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.685335:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685350:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.685353:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685361:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685372:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685380:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d44 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.685717:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.685720:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.685722:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.687119:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.687849:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.687861:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.687901:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.687908:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.688098:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.688120:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.688163:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.688171:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.689361:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925267.701821:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.701851:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.701867:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ca00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.701874:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.701887:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.701937:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.701945:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423d4b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788925267.703680:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.703693:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703711:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.703716:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.703723:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703737:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703777:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703786:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703808:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925267.703841:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.703847:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703855:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.703860:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703869:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703885:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703892:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423d52 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.703910:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.703913:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.703915:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.705863:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.705870:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.705873:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.706544:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.706556:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.706576:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.706591:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.706617:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.706644:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.706663:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.706677:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.706713:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.707082:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.707091:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.707100:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.707105:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.707116:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.707149:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.707175:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc508e88/0x45e32cfaf7423d59 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.707210:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.707213:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.707214:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.707653:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.707677:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.707689:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.707693:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.707698:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.707709:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.707718:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.707733:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.707755:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.708128:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.708134:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.708144:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.708148:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.708157:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.708170:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.708178:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a51bc6db/0x45e32cfaf7423d60 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.708219:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.708221:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.708223:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.710234:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.710254:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710274:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.710279:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.710286:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710302:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710315:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710324:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710349:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925267.710371:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.710377:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710396:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.710421:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710433:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710452:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710459:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423d67 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.710482:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.710484:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.710485:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.714819:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.714854:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.714884:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.714889:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.714912:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.715334:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.715370:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.715380:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.715564:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788925267.717505:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.717523:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.717547:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.717553:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.717561:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.717592:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.717604:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.717613:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718817:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788925267.718839:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718851:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.718857:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718868:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718892:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718899:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000726619a8/0x45e32cfaf7423d6e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718942:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.718953:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718960:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.718982:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.718990:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.719000:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.719013:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.719015:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.719017:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.722743:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788925267.722773:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423d75 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.722907:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925267.724350:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925267.724360:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.724376:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1788925267.724380:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925267.724385:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.724438:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.724466:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.724492:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.724525:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925267.725038:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925267.725046:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.725073:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166dc00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925267.725078:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.725088:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.725108:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.725123:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b10a2558/0x45e32cfaf7423d7c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.725160:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.725169:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.725171:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925267.725735:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925267.725741:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.725770:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1788925267.725775:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925267.725780:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.725792:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.725801:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.725809:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.726005:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788925267.727022:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925267.727032:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.727062:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1788925267.727066:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925267.727072:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.727087:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.727096:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.727116:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727540:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925267.727555:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727564:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.727569:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727595:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727624:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727632:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bf85b93/0x45e32cfaf7423d83 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727651:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925267.727655:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727692:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.727705:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727713:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727724:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.727732:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.727734:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.727736:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.728160:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788925267.728166:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d783ab04/0x45e32cfaf7423d8a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.730024:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925267.730070:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925267.730080:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.730152:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1788925267.730157:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925267.730164:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.730254:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.730265:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.730290:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.730347:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788925267.733532:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925267.733549:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.733760:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=653s v=(0 0) 00010000:00010000:2.0:1788925267.733765:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925267.733773:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.733789:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.733800:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.733836:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.734075:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925267.734085:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.734093:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925267.734098:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.734112:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.734139:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.734156:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007a446817/0x45e32cfaf7423d91 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736097:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.736133:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.736144:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736157:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.736165:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736176:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736216:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736223:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae5eaae4/0x45e32cfaf7423d98 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.736272:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.736274:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.736331:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.738810:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925267.742472:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925267.742493:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.742517:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=653s v=(0 0) 00010000:00010000:3.0:1788925267.742523:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925267.742531:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.742549:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.742563:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.742572:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.742595:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925267.742862:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925267.742871:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.742881:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925267.742886:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.742897:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.742916:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.742924:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1af42b5/0x45e32cfaf7423d9f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.742945:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.742946:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.742948:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.744169:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.744182:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.744267:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.744277:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.744283:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.744297:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.744316:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.744324:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.744436:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788925267.747052:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.747066:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.747085:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.747091:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.747098:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.747136:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.747160:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.747177:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.747885:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788925267.747929:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.747941:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858cc00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.747947:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.747964:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.747990:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.747999:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423da6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.748035:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.748040:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.748047:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ca00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.748050:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.748059:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.748083:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 2/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.748092:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.748094:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.748096:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.762728:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.762743:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788925267.762758:0:24673:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788925267.763394:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.763432:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.763452:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.763457:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.763464:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.763481:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.763493:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.763500:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.763520:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.763934:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.763943:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.763954:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.763959:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.763970:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.763990:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.763999:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423db4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764020:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.764022:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.764030:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.764181:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.764187:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764209:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.764212:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.764217:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764228:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764237:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764245:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764264:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788925267.764587:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.764593:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.764602:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.764606:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.764610:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764792:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.764798:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764807:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.764811:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764821:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764844:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764852:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dbb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.764865:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.764867:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.764868:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925267.764898:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.765369:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.765378:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.765420:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.765865:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.765872:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.765882:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.765886:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.765909:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788925267.766043:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.766050:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.766063:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.766067:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.766074:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.766086:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.766116:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.766124:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.766165:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.766780:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766789:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c43301ba/0x45e32cfaf7423dc2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766811:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.766815:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766822:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.766837:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766847:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766858:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766866:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046c830b8/0x45e32cfaf7423dc9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.766893:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.766895:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.766897:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925267.767134:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.767998:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.768024:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768039:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.768043:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.768050:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768063:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768073:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768093:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768109:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.768380:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.768387:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.768397:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ca00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.768419:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.768430:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.768444:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.768453:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009ae19622/0x45e32cfaf7423dd0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.768469:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.768471:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.768473:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.768912:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.768974:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.768986:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.768990:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.768996:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.769007:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.769016:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.769024:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.769045:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.769792:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.769800:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.769823:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858cc00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.769838:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.769848:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.769865:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.769874:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ef03532/0x45e32cfaf7423dd7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.769891:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.769892:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.769894:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.770185:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.770193:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.770212:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.770216:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.770221:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.770233:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.770242:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.770250:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.770270:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.771002:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.771011:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.771022:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.771027:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.771037:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.771062:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.771070:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5a765c/0x45e32cfaf7423dde lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.771090:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.771092:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.771094:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.772083:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.772095:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.772110:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.772115:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.772128:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.772143:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.772178:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.772186:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.772212:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.772565:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.772573:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.772587:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.772592:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.772625:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.772642:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.772650:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068256841/0x45e32cfaf7423de5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.772773:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.772775:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.772777:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.774012:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.774024:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.774046:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.774051:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.774063:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.774077:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.774093:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.774102:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.774138:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.775005:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.775014:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.775030:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.775036:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.775046:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.775065:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.775073:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003338bd74/0x45e32cfaf7423dec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.775111:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.775113:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.775115:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.776391:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.777252:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.777287:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.777292:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.777298:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.777323:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.777335:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.777343:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.777463:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.777840:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.777850:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.777872:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1a00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.777885:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.777896:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.778122:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.778133:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bfcb87a5/0x45e32cfaf7423df3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.778164:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.778172:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.778175:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.779192:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.779325:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.779347:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.779352:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.779359:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.779378:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.779390:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.779425:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.779451:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788925267.779460:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925267.779467:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.779476:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925267.779490:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.779500:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.779517:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.779525:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076680554/0x45e32cfaf7423dfa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.779542:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.779544:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.779546:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925267.783729:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925267.783782:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.783809:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=653s v=(0 0) 00010000:00010000:1.0:1788925267.783865:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925267.783873:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.783894:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.783906:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.783928:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925267.783976:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925267.784014:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925267.784023:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.784032:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925267.784036:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.784059:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.784087:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.784095:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003689ef24/0x45e32cfaf7423e01 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925267.784113:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.784115:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925267.784117:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.792175:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.792193:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.792214:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.792219:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.792240:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.792257:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.792269:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.792279:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.792298:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788925267.792743:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925267.792752:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.792762:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925267.792768:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.792779:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.792798:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.792818:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da5f80f2/0x45e32cfaf7423e08 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.792854:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.792856:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.792858:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788925267.793304:0:24673:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788925267.793311:0:24673:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.793322:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=653s v=(0 0) 00010000:00010000:0.0:1788925267.793325:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925267.793330:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.793345:0:24673:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.793353:0:24673:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.793374:0:24673:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925267.793436:0:24673:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788925267.793738:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925267.793745:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.793754:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925267.793758:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.793766:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.793784:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.793792:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e9afdd5/0x45e32cfaf7423e0f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925267.793811:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.793813:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925267.793814:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788925267.794096:0:24673:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788925267.794244:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22657:x1875823470839680:12345-0@lo:5:osp-pre-0-0.0 Request processed in 148096us (148851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925267.794260:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788925267.794449:0:22657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22657:1875823470839680:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788925267.794469:0:22657:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788925267.794532:0:22657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22657:1875823470839808:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788925267.794589:0:22657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925267.794775:0:22657:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a3409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925267.794869:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839808 00000100:00100000:0.0:1788925267.794878:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839808 00000100:00100000:0.0:1788925267.795004:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788925267.795015:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22657:x1875823470839808:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788925267.795063:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000001:00080000:0.0:1788925267.808557:0:24133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:0.0:1788925267.808601:0:24133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788925267.808606:0:24133:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000100:00100000:1.0:1788925267.808910:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22657:x1875823470839808:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13893us (14316us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1788925267.808928:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788925267.809720:0:22657:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788925267.809736:0:22657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22657:1875823470839808:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788925267.809754:0:22657:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:2.0:1788925268.140030:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925268.140060:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470839936:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788925268.140304:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925268.140504:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470839936 00000100:00100000:2.0:1788925268.140515:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470839936 00000100:00100000:2.0:1788925268.140990:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788925268.141003:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470839936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788925268.141047:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788925268.141107:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470839936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 108us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925268.141127:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788925268.141183:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470839936:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788925268.204228:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925269.239952:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788925269.806530:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788925270.267006:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925271.293207:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925271.722697:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788925271.722728:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470840064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925271.722830:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925271.722892:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840064 00000100:00100000:1.0:1788925271.722902:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840064 00000100:00100000:1.0:1788925271.722966:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788925271.722976:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470840064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788925271.723013:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788925271.723062:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470840064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 88us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925271.723085:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788925271.723111:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925271.723146:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788925271.723173:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470840064:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788925272.300382:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925272.748576:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470840192:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925272.748686:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.748787:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840192 00000100:00100000:2.0:1788925272.748798:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840192 00000100:00100000:2.0:1788925272.748870:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788925272.748881:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470840192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925272.748908:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925272.748960:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470840192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925272.748967:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788925272.748990:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925272.749035:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470840192:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925272.749241:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925272.749253:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470840320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925272.749302:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925272.749338:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840320 00000100:00100000:0.0:1788925272.749342:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840320 00000100:00100000:0.0:1788925272.749386:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788925272.749393:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470840320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788925272.749460:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925272.749500:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e352a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470840320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 108us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925272.749506:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788925272.749544:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470840320:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925272.793068:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470840448:0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.793174:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.793837:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840448 00000100:00100000:2.0:1788925272.793849:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840448 00000100:00100000:2.0:1788925272.793913:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788925272.793924:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:3622:x1875823470840448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.794000:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:3622:x1875823470840448:12345-0@lo:400:kworker.0 Request processed in 77us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925272.794007:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788925272.794072:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470840448:0@lo:400:kworker.0 00000100:00080000:2.0:1788925272.795032:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925272.795038:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788925272.795042:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925272.795048:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 653 00000100:00080000:2.0:1788925272.795054:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788925272.795064:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925272.795092:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925272.795106:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470840576:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795159:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.795218:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5041cdf80 x1875823470840704/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925272.795253:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470840832:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795295:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788925272.795339:0:16480:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788925272.795343:0:16480:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788925272.795345:0:16480:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788925272.795348:0:16480:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 653 00000100:00080000:2.0:1788925272.795351:0:16480:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788925272.795356:0:16480:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:2.0:1788925272.795378:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470840960:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795436:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.795476:0:16480:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5041cd880 x1875823470841088/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788925272.795505:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470841216:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795534:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.795579:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925272.795585:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470841344:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795616:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925272.795655:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470841472:0@lo:400:kworker.0 00000100:00100000:2.0:1788925272.795679:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.795874:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470840704:0@lo:8:kworker.0 00000100:00100000:1.0:1788925272.795910:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.795930:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470841088:0@lo:8:kworker.0 00000100:00100000:1.0:1788925272.795950:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925272.795985:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840960 00000100:00100000:1.0:1788925272.795992:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840960 00000100:00100000:1.0:1788925272.796038:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840704 00000100:00100000:1.0:1788925272.796041:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840704 00000100:00100000:1.0:1788925272.796050:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841088 00000100:00100000:1.0:1788925272.796052:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841088 00000100:00100000:1.0:1788925272.796063:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925272.796071:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470840960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.796122:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ced80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470840960:12345-0@lo:400:kworker.0 Request processed in 51us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.796130:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788925272.796147:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925272.796152:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470840704:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788925272.796175:0:24139:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788925272.796208:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470840704:12345-0@lo:8:kworker.0 Request processed in 55us (298us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788925272.796222:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925272.796234:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788925272.796238:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470841088:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788925272.796248:0:24139:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788925272.796273:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470841088:12345-0@lo:8:kworker.0 Request processed in 34us (322us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788925272.796279:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788925272.796299:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840832 00000100:00100000:1.0:1788925272.796304:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840832 00000100:00100000:1.0:1788925272.796321:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841216 00000100:00100000:1.0:1788925272.796324:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841216 00000100:00100000:1.0:1788925272.796334:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841344 00000100:00100000:1.0:1788925272.796336:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841344 00000100:00100000:1.0:1788925272.796359:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841472 00000100:00100000:1.0:1788925272.796362:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841472 00000100:00100000:1.0:1788925272.796393:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925272.796399:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470840832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.796451:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875823470840832:12345-0@lo:400:kworker.0 Request processed in 52us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.796457:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788925272.796469:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925272.796474:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470841216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.796507:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470841216:12345-0@lo:400:kworker.0 Request processed in 32us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.796513:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788925272.796524:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925272.796530:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470841344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.796567:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875823470841344:12345-0@lo:400:kworker.0 Request processed in 37us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.796573:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788925272.796585:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925272.796591:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470841472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925272.796617:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875823470841472:12345-0@lo:400:kworker.0 Request processed in 26us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925272.796622:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788925272.796673:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470840960:0@lo:400:kworker.0 00000100:00080000:1.0:1788925272.796719:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925272.796724:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925272.796727:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470840704:0@lo:8:kworker.0 00000100:00080000:1.0:1788925272.796735:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788925272.796738:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788925272.796740:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470841088:0@lo:8:kworker.0 00000100:00080000:1.0:1788925272.796758:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788925272.796763:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788925272.796778:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5041cc000 x1875823470841216/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925272.796788:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470841216:0@lo:400:kworker.0 00010000:00080000:2.0:1788925272.797384:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5041cc380 x1875823470841472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925272.797396:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3624:1875823470841472:0@lo:400:kworker.0 00010000:00080000:2.0:1788925272.797432:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5041cd180 x1875823470841344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925272.797440:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3624:1875823470841344:0@lo:400:kworker.0 00010000:00080000:2.0:1788925272.797449:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5041cf800 x1875823470840832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925288 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925272.797456:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875823470840832:0@lo:400:kworker.0 00000100:00100000:3.0:1788925272.798860:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470840576 00000100:00100000:3.0:1788925272.798873:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470840576 00000100:00100000:3.0:1788925272.805690:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925272.805725:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470840576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925272.805878:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470840576:12345-0@lo:400:kworker.0 Request processed in 163us (10717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925272.805887:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788925272.805975:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470840576:0@lo:400:kworker.0 00000100:00100000:3.0:1788925273.259517:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470841600:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925273.259930:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925273.260088:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841600 00000100:00100000:0.0:1788925273.260099:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841600 00000100:00100000:0.0:1788925273.260166:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788925273.260179:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470841600:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925273.260223:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925273.260296:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470841600:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925273.260304:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788925273.260452:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470841600:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788925273.326252:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925274.347332:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788925274.796347:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788925275.023752:0:24952:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788925275.023756:0:24952:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788925275.023757:0:24952:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788925275.023889:0:24952:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff97a6068ed800 00000020:01000004:0.0:1788925275.023904:0:24952:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788925275.023918:0:24952:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788925275.023931:0:24952:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff97a503744d40) 00000020:00000080:0.0:1788925275.023947:0:24952:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788925275.140300:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788925275.145175:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788925275.145475:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788925275.145953:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788925275.146169:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788925275.146366:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788925275.146853:0:24952:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:0.0:1788925275.159023:0:24952:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788925275.159252:0:24952:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788925275.159266:0:24952:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788925275.159278:0:24952:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45e32cfaf7423e1d 00000020:01000004:0.0:1788925275.159285:0:24952:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788925275.159305:0:24952:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788925275.159309:0:24952:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788925275.159314:0:24952:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788925275.159344:0:24952:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788925275.159348:0:24952:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788925275.182762:0:24952:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788925275.182809:0:24952:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.151@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788925275.182813:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788925275.182815:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788925275.182816:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925275.182817:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925275.182818:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925275.182820:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925275.182821:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925275.182822:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925275.182824:0:24952:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925275.182827:0:24952:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788925275.182829:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788925275.182830:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788925275.182831:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925275.182832:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925275.182832:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925275.182834:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925275.182835:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925275.182836:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925275.182837:0:24952:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788925275.182860:0:24952:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788925275.182885:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788925275.182956:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.183010:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60489eb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.183122:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841728 00000100:00100000:3.0:1788925275.183131:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841728 00000100:00100000:3.0:1788925275.183189:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788925275.183198:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24952:x1875823470841728:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788925275.183227:0:22626:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788925275.183236:0:22626:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:3.0:1788925275.183240:0:22626:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788925275.183873:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24952:x1875823470841728:12345-0@lo:253:mount.lustre.0 Request processed in 674us (914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.183890:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788925275.184029:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788925275.184042:0:24952:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788925275.184045:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788925275.184046:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788925275.184048:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788925275.184049:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788925275.184050:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788925275.184051:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788925275.184052:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788925275.184054:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788925275.184055:0:24952:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788925275.184075:0:24952:0:(tgt_mount.c:101:server_register_mount()) register mount ffff97a6068ed800 from lustre-OST0001 10000000:01000000:0.0:1788925275.184102:0:24952:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788925275.184104:0:24952:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788925275.184112:0:24952:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff97a60841cd40 local copy 00010000:00010000:0.0:1788925275.184121:0:24952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925275.184224:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788925275.184256:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.184292:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635839300 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.184342:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841856 00000100:00100000:2.0:1788925275.184347:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841856 00000100:00100000:2.0:1788925275.184388:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788925275.184396:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24952:x1875823470841856:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925275.184551:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:24952:x1875823470841856:12345-0@lo:501:mount.lustre.0 Request processed in 156us (295us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925275.184558:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788925275.187811:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e351500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841856:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788925275.187841:0:24952:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788925275.188246:0:24952:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788925275.188256:0:24952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.188267:0:24952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61858d800/0x45e32cfaf7423a50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423a57 expref: -99 pid: 22611 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925275.188302:0:24952:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97a6068ed800 10000000:01000000:1.0:1788925275.188313:0:24952:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788925275.188320:0:24952:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788925275.188325:0:24952:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788925275.188329:0:24952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788925275.188332:0:24952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788925275.188368:0:24952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.188376:0:24952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.188386:0:24952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925275.188445:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841984:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788925275.188506:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.188618:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef98000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.191751:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470841984 00000100:00100000:3.0:1788925275.191767:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470841984 00000100:00100000:2.0:1788925275.194904:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788925275.194920:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:24952:x1875823470841984:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788925275.194938:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925275.194955:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423e2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423e24 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925275.194982:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423e24 expref: 22 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925275.195010:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166d600/0x45e32cfaf7423e2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e24 expref: 22 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925275.195018:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166d600, rc 0) 00000100:00100000:2.0:1788925275.195098:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470841984:12345-0@lo:101:mount.lustre.0 Request processed in 181us (6592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.195105:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788925275.195198:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470841984:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788925275.195216:0:24952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e2b expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.195236:0:24952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423e2b expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925275.204799:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1788925275.205783:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925275.213212:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788925275.213270:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788925275.213287:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788925275.213301:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788925275.213314:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788925275.213328:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788925275.213342:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788925275.214769:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788925275.214815:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1788925275.214842:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1788925275.214850:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1788925275.216166:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925275.216233:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.216802:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef986c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925275.219264:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842112 00000100:00100000:0.0:1788925275.219279:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842112 00000100:00100000:0.0:1788925275.219337:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788925275.219347:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842112:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925275.223684:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842112:12345-0@lo:501:mount.lustre.0 Request processed in 4285us (7397us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.223703:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788925275.223728:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842112:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925275.223780:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788925275.223842:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.223896:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.225906:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842240 00000100:00100000:2.0:1788925275.225920:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842240 00000100:00100000:2.0:1788925275.225983:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788925275.225993:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842240:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925275.227818:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842240:12345-0@lo:503:mount.lustre.0 Request processed in 1821us (3969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.227831:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788925275.227942:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842240:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788925275.228319:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925275.228460:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842368:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925275.228508:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.228544:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef98000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.228807:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842368 00000100:00100000:2.0:1788925275.228813:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842368 00000100:00100000:2.0:1788925275.228854:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788925275.228861:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842368:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925275.229352:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842368:12345-0@lo:502:mount.lustre.0 Request processed in 482us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.229359:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788925275.229566:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842368:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925275.229722:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788925275.229746:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788925275.229768:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788925275.229780:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788925275.229805:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788925275.229820:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788925275.229833:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788925275.229843:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788925275.229854:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:1.0:1788925275.229940:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842496:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925275.229976:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.230006:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef98000 going to sleep for 11 seconds 00000100:00100000:0.0:1788925275.230150:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842496 00000100:00100000:0.0:1788925275.230156:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842496 00000100:00100000:0.0:1788925275.230195:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788925275.230205:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842496:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788925275.230657:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842496:12345-0@lo:502:mount.lustre.0 Request processed in 452us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.230671:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788925275.232131:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842496:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925275.232220:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1788925275.232233:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788925275.234507:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788925275.234516:0:24956:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788925275.234523:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788925275.234526:0:24956:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788925275.234537:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788925275.234553:0:24956:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff97a635998000) 00000020:00000080:1.0:1788925275.234577:0:24956:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788925275.234583:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788925275.234660:0:24956:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a6068ed800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788925275.234669:0:24956:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788925275.234676:0:24956:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x45e32cfaf7423e39 00010000:00010000:1.0:1788925275.245764:0:24956:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788925275.248849:0:24956:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934599 00080000:10000000:2.0:1788925275.250692:0:24956:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788925275.252065:0:24956:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1788925275.252077:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925275.252083:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925275.252085:0:24956:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1788925275.252089:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925275.252093:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925275.252094:0:24956:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788925275.252097:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788925275.252099:0:24956:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788925275.252101:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925275.252103:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925275.252104:0:24956:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788925275.252106:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788925275.252109:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925275.252110:0:24956:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788925275.252113:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788925275.252137:0:24956:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788925275.252140:0:24956:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788925275.252141:0:24956:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788925275.252145:0:24956:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788925275.252573:0:24952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788925275.252601:0:24952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788925275.252613:0:24952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e2b expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.252625:0:24952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c436c00/0x45e32cfaf7423e24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e2b expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925275.252633:0:24952:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a6068ed800 from 1 10000000:01000000:1.0:1788925275.252636:0:24952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925275.252669:0:24952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.252677:0:24952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.252688:0:24952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925275.252710:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788925275.252769:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.252833:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5025926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.252844:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842624 00000100:00100000:3.0:1788925275.252852:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842624 00000100:00100000:3.0:1788925275.252925:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925275.252935:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:24952:x1875823470842624:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925275.252948:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925275.252960:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423e40 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.252980:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.252990:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.252998:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f06a00, rc 0) 00000100:00100000:3.0:1788925275.253038:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470842624:12345-0@lo:101:mount.lustre.0 Request processed in 105us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.253045:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788925275.253101:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842624:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925275.253115:0:24952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.253139:0:24952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925275.257517:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:1.0:1788925275.257756:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925275.257939:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:1.0:1788925275.257961:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:1.0:1788925275.257973:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:1.0:1788925275.257984:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:1.0:1788925275.258002:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:1.0:1788925275.258013:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:1.0:1788925275.258024:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:1.0:1788925275.258035:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:1.0:1788925275.258045:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:1.0:1788925275.258056:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:1.0:1788925275.258078:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:1.0:1788925275.258095:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:1.0:1788925275.258100:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:1.0:1788925275.258165:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925275.258221:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.258254:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5025926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.261713:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842752 00000100:00100000:3.0:1788925275.261730:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842752 00000100:00100000:3.0:1788925275.262229:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788925275.262240:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470842752:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925275.262426:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470842752:12345-0@lo:501:mount.lustre.0 Request processed in 187us (4203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.262434:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788925275.263304:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788925275.263362:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842880:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788925275.263441:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.266759:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5025926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.266836:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470842880 00000100:00100000:2.0:1788925275.266885:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470842880 00000100:00100000:2.0:1788925275.266934:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788925275.266943:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470842880:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788925275.267082:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470842880:12345-0@lo:503:mount.lustre.0 Request processed in 140us (3641us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.267091:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788925275.268394:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470842880:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788925275.269359:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788925275.269566:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843008:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925275.269636:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.269710:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5025926c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.269818:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843008 00000100:00100000:2.0:1788925275.269824:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843008 00000100:00100000:2.0:1788925275.270037:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788925275.270047:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470843008:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925275.270165:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470843008:12345-0@lo:502:mount.lustre.0 Request processed in 119us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.270174:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788925275.270250:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843008:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925275.270473:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:1.0:1788925275.270501:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:1.0:1788925275.270516:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:1.0:1788925275.270529:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:1.0:1788925275.270542:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:1.0:1788925275.270566:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:1.0:1788925275.270580:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:1.0:1788925275.270593:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:1.0:1788925275.270606:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:1.0:1788925275.270620:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:1.0:1788925275.270645:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:1.0:1788925275.270669:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843136:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788925275.270705:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.271161:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5025926c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.271197:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843136 00000100:00100000:3.0:1788925275.271206:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843136 00000100:00100000:3.0:1788925275.271272:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788925275.271280:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470843136:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.271425:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470843136:12345-0@lo:502:mount.lustre.0 Request processed in 145us (718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.271432:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788925275.271586:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843136:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788925275.271637:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:1.0:1788925275.271647:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788925275.273130:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925275.273153:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.273155:0:24960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788925275.273164:0:24960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a6068ed800 00000020:00000080:3.0:1788925275.273168:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925275.273176:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925275.273179:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.273180:0:24960:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788925275.273182:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925275.273185:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.273192:0:24960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788925275.273197:0:24960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff97a6068ed800 00000020:00000080:3.0:1788925275.273199:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925275.273363:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925275.273367:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.273368:0:24960:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788925275.273370:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925275.273373:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.273374:0:24960:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788925275.273378:0:24960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a6068ed800 00000020:00000080:3.0:1788925275.273380:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925275.279300:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925275.279312:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.279314:0:24960:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788925275.279319:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788925275.279323:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.279324:0:24960:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788925275.279329:0:24960:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff97a6068ed800 00000020:00000080:3.0:1788925275.279331:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788925275.279392:0:24960:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788925275.279395:0:24960:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788925275.279397:0:24960:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788925275.279415:0:24960:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788925275.280848:0:24952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788925275.281078:0:24952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788925275.281096:0:24952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281109:0:24952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925275.281163:0:24952:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788925275.281166:0:24952:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97a6068ed800 10000000:01000000:3.0:1788925275.281175:0:24952:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97a6068ed800 10000000:01000000:3.0:1788925275.281179:0:24952:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788925275.281185:0:24952:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97a6068ed800 from 1 10000000:01000000:3.0:1788925275.281187:0:24952:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788925275.281221:0:24952:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281230:0:24952:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281241:0:24952:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925275.281266:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843264:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788925275.281325:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.281361:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.281384:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843264 00000100:00100000:3.0:1788925275.281391:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843264 00000100:00100000:3.0:1788925275.281447:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788925275.281456:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:24952:x1875823470843264:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925275.281468:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925275.281479:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a501f07c00/0x45e32cfaf7423e55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423e4e expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281500:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f07c00/0x45e32cfaf7423e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423e4e expref: 24 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281509:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a501f07c00/0x45e32cfaf7423e55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e4e expref: 24 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281527:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a501f07c00, rc 0) 00000100:00100000:3.0:1788925275.281561:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843264:12345-0@lo:101:mount.lustre.0 Request processed in 107us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.281568:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788925275.281613:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843264:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788925275.281626:0:24952:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e55 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.281635:0:24952:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423e55 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788925275.286646:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788925275.288207:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788925275.288469:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788925275.288495:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788925275.288508:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788925275.288521:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788925275.288535:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788925275.288548:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788925275.288560:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788925275.288574:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788925275.288588:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788925275.288620:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788925275.288636:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788925275.288647:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788925275.288659:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788925275.288671:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788925275.288682:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788925275.288706:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788925275.288719:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788925275.288749:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788925275.288762:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788925275.288773:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788925275.288796:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788925275.288811:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788925275.288824:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788925275.288837:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788925275.288849:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788925275.291851:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788925275.291960:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788925275.291977:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788925275.291991:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788925275.292005:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788925275.292020:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788925275.292031:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788925275.292043:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788925275.292055:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788925275.292068:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788925275.292080:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788925275.292092:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788925275.292105:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788925275.292117:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788925275.292128:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788925275.292139:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788925275.292167:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788925275.292183:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788925275.292196:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788925275.292209:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788925275.292223:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788925275.292236:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788925275.292249:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788925275.293476:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788925275.293520:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788925275.293544:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788925275.293550:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788925275.293656:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925275.293716:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.294473:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed180 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.294626:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843392 00000100:00100000:2.0:1788925275.294634:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843392 00000100:00100000:2.0:1788925275.294684:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788925275.294693:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843392:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788925275.294841:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843392:12345-0@lo:501:mount.lustre.0 Request processed in 148us (1123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.294848:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788925275.295051:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843392:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788925275.295089:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843520:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925275.295136:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.295155:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed180 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.295169:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843520 00000100:00100000:3.0:1788925275.295173:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843520 00000100:00100000:3.0:1788925275.295233:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925275.295241:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843520:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788925275.295316:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843520:12345-0@lo:503:mount.lustre.0 Request processed in 75us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.295323:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788925275.295362:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843520:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788925275.295768:0:24952:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788925275.295834:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843648:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.295868:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.296296:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843648 00000100:00100000:3.0:1788925275.296302:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843648 00000100:00100000:3.0:1788925275.296327:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788925275.296334:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843648:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.296449:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843648:12345-0@lo:502:mount.lustre.0 Request processed in 115us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.296457:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788925275.296493:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.296509:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843648:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925275.296663:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1788925275.296687:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1788925275.296701:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1788925275.296746:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1788925275.296762:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1788925275.296773:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1788925275.296784:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1788925275.296809:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1788925275.296822:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1788925275.296836:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1788925275.296849:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1788925275.299217:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1788925275.299273:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1788925275.299290:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1788925275.299305:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1788925275.299319:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1788925275.299332:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1788925275.299345:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1788925275.299359:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1788925275.299393:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1788925275.303645:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1788925275.303670:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1788925275.303690:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1788925275.303708:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1788925275.303740:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1788925275.303771:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1788925275.303785:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1788925275.303813:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1788925275.303828:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1788925275.303848:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1788925275.304063:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1788925275.304081:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1788925275.304092:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1788925275.304103:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1788925275.304114:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1788925275.304138:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1788925275.304150:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1788925275.304160:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1788925275.304171:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1788925275.304182:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1788925275.304192:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1788925275.304203:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1788925275.304213:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1788925275.304226:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1788925275.304237:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1788925275.304247:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1788925275.304258:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1788925275.304269:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1788925275.304317:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843776:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.304385:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.304449:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843776 00000100:00100000:3.0:1788925275.304456:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843776 00000100:00100000:3.0:1788925275.304489:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788925275.304496:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843776:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.304592:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843776:12345-0@lo:502:mount.lustre.0 Request processed in 95us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.304606:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788925275.304658:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925275.304676:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843776:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925275.305274:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:3.0:1788925275.305297:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:3.0:1788925275.305317:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843904:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788925275.305353:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.308387:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.312472:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470843904 00000100:00100000:2.0:1788925275.312485:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470843904 00000100:00100000:2.0:1788925275.312568:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788925275.312578:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843904:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788925275.312734:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470843904:12345-0@lo:502:mount.lustre.0 Request processed in 146us (7369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.312750:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788925275.318505:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470843904:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788925275.318596:0:24952:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:3.0:1788925275.318610:0:24952:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788925275.319460:0:24966:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788925275.319475:0:24966:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff97a501f399c0) 00000020:00000080:3.0:1788925275.319500:0:24966:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788925275.319571:0:24966:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a6068ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788925275.319575:0:24966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a6068ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788925275.319578:0:24966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a6068ed800 3 00010000:00080000:3.0:1788925275.319608:0:24966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a501f22800@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1788925275.328589:0:24966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788925275.331137:0:24966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788925275.331186:0:24966:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788925275.331198:0:24966:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x45e32cfaf7423e63 00000100:00080000:3.0:1788925275.331335:0:24966:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925275.331348:0:24966:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff97a501f22800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925275.331381:0:24966:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5010aca80 x1875823470844032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925275.331435:0:24966:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788925275.331504:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925275.331508:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925275.331511:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925275.331515:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 658 00000100:00080000:3.0:1788925275.331518:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788925275.331523:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925275.331536:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5010ad880 x1875823470844416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925275.331562:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925275.331565:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925275.331567:0:36:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925275.331569:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 658 00000100:00080000:3.0:1788925275.331571:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788925275.331575:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925275.331587:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a5010ae680 x1875823470844928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788925275.331813:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470844032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788925275.331878:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.331913:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470844416:0@lo:8:kworker.0 00000100:00100000:3.0:1788925275.331934:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470844160:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.331942:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.331960:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470844928:0@lo:8:kworker.0 00000100:00100000:3.0:1788925275.331983:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.331989:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.332013:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470844800:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.338460:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844032 00000100:00100000:0.0:1788925275.338475:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844032 00000100:00100000:0.0:1788925275.338514:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925275.338530:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875823470844032:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788925275.338571:0:22634:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:0.0:1788925275.338618:0:22634:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x45e32cfaf7423e6a 00000004:00100000:0.0:1788925275.338634:0:22634:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788925275.338662:0:22634:0:(import.c:65:import_set_state_nolock()) ffff97a503821000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925275.338730:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e351500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3620:x1875823470844032:12345-0@lo:38:llog_process_th.0 Request processed in 201us (6851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.338737:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925275.338762:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844416 00000100:00100000:0.0:1788925275.338766:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844416 00000100:00100000:0.0:1788925275.338782:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844928 00000100:00100000:0.0:1788925275.338784:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844928 00000100:00100000:0.0:1788925275.338814:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925275.338819:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470844416:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788925275.338864:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470844416:12345-0@lo:8:kworker.0 Request processed in 43us (6925us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788925275.338870:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925275.338881:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925275.338884:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470844928:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788925275.338910:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470844928:12345-0@lo:8:kworker.0 Request processed in 25us (6923us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788925275.338916:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788925275.338969:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010aca80 x1875823470844032/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925275.338979:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925275.338986:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:0.0:1788925275.338993:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788925275.339003:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788925275.339006:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501f22800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788925275.339011:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3620:1875823470844032:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788925275.339026:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925275.339028:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925275.339031:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788925275.339034:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470844416:0@lo:8:kworker.0 00000100:00100000:0.0:1788925275.339041:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788925275.339043:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788925275.339046:0:3620:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788925275.339049:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470844928:0@lo:8:kworker.0 00000100:00100000:3.0:1788925275.341767:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.341830:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788925275.341842:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470844672:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.341896:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.341967:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470845312:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.342014:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.342057:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470844288:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.342081:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.342098:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470845056:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.342118:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.342139:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788925275.342145:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470844544:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.342166:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.342182:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1875823470845184:0@lo:400:kworker.0 00000100:00100000:3.0:1788925275.342200:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.342453:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844800 00000100:00100000:0.0:1788925275.342461:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844800 00000100:00100000:0.0:1788925275.342516:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844288 00000100:00100000:0.0:1788925275.342520:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844288 00000100:00100000:0.0:1788925275.342545:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925275.342554:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470844800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.342949:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470844800:12345-0@lo:400:kworker.0 Request processed in 395us (1188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.342957:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788925275.342978:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788925275.342986:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470844288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343024:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470844288:12345-0@lo:400:kworker.0 Request processed in 39us (941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.343030:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788925275.343065:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845312 00000100:00100000:0.0:1788925275.343069:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845312 00000100:00100000:0.0:1788925275.343100:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845056 00000100:00100000:0.0:1788925275.343103:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845056 00000100:00100000:0.0:1788925275.343118:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844544 00000100:00100000:0.0:1788925275.343121:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844544 00000100:00100000:0.0:1788925275.343137:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845184 00000100:00100000:0.0:1788925275.343140:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845184 00000100:00100000:0.0:1788925275.343163:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788925275.343170:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470845312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343205:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470845312:12345-0@lo:400:kworker.0 Request processed in 36us (1190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.343211:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788925275.343224:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925275.343229:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470845056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343257:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470845056:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.343262:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788925275.343275:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925275.343280:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470844544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343307:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470844544:12345-0@lo:400:kworker.0 Request processed in 26us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.343312:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788925275.343322:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788925275.343327:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875823470845184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343358:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875823470845184:12345-0@lo:400:kworker.0 Request processed in 31us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.343374:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788925275.343398:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925275.343423:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925275.343426:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788925275.343465:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010ac700 x1875823470844544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925275.343486:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470844544:0@lo:400:kworker.0 00010000:00080000:0.0:1788925275.343503:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010adf80 x1875823470845184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925275.343511:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3623:1875823470845184:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.343523:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470844288:0@lo:400:kworker.0 00010000:00080000:0.0:1788925275.343531:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010adc00 x1875823470845056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925275.343538:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470845056:0@lo:400:kworker.0 00010000:00080000:0.0:1788925275.343571:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a5010ace00 x1875823470845312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925291 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925275.346618:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844160 00000100:00100000:1.0:1788925275.346633:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844160 00000100:00100000:1.0:1788925275.346684:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470844672 00000100:00100000:1.0:1788925275.346687:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470844672 00000100:00100000:1.0:1788925275.346704:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788925275.346713:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470844160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.346803:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470844160:12345-0@lo:400:kworker.0 Request processed in 91us (14821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925275.346809:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788925275.346824:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925275.346830:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470844672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925275.346855:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470844672:12345-0@lo:400:kworker.0 Request processed in 26us (4958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925275.346861:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788925275.348877:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470845312:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.348922:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470844160:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.348938:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470844800:0@lo:400:kworker.0 00000100:00100000:0.0:1788925275.348972:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470844672:0@lo:400:kworker.0 00000020:01000004:3.0:1788925275.353876:0:24966:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788925275.353894:0:24966:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff97a5038b3380) 00000020:00000080:3.0:1788925275.353920:0:24966:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000020:01000004:3.0:1788925275.354018:0:24966:0:(tgt_mount.c:153:server_get_mount()) get mount ffff97a6068ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788925275.354022:0:24966:0:(tgt_mount.c:187:server_put_mount()) put mount ffff97a6068ed800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788925275.354025:0:24966:0:(obd_mount.c:710:lustre_put_lsi()) put ffff97a6068ed800 3 00010000:00080000:3.0:1788925275.354054:0:24966:0:(ldlm_lib.c:102:import_set_conn()) imp ffff97a501f26000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.151@tcp at head 00010000:00010000:3.0:1788925275.356687:0:24966:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788925275.356910:0:24966:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788925275.356959:0:24966:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788925275.356973:0:24966:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x45e32cfaf7423e78 00000100:00080000:3.0:1788925275.356983:0:24966:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788925275.356994:0:24966:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff97a501f26000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925275.357031:0:24966:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a604898700 x1875823470845440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788925275.357066:0:24966:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788925275.357269:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1875823470845440:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788925275.357337:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925275.357537:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845440 00000100:00100000:3.0:1788925275.357545:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845440 00000100:00100000:3.0:1788925275.357582:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788925275.357589:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3620:x1875823470845440:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788925275.357614:0:22634:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 661 last 0 00000020:00000080:3.0:1788925275.357655:0:22634:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x45e32cfaf7423e7f 00000004:00100000:3.0:1788925275.357668:0:22634:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788925275.357699:0:22634:0:(import.c:65:import_set_state_nolock()) ffff97a503baf000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788925275.357749:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3620:x1875823470845440:12345-0@lo:38:llog_process_th.0 Request processed in 159us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925275.357756:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788925275.357812:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff97a604898700 x1875823470845440/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788925285 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925275.357822:0:3620:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788925275.357829:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788925275.357836:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788925275.357840:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788925275.357842:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501f26000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788925275.357846:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3620:1875823470845440:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788925275.359673:0:24966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788925275.360474:0:24952:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788925275.360505:0:24952:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788925275.360527:0:24952:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e55 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.360539:0:24952:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a501f07200/0x45e32cfaf7423e4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e55 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788925275.360588:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788925275.360590:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925275.360591:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925275.360592:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925275.360593:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925275.360594:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925275.360596:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925275.360598:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925275.360599:0:24952:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925275.360602:0:24952:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788925275.360605:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788925275.360606:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925275.360607:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925275.360608:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925275.360609:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925275.360610:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925275.360611:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925275.360612:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925275.360613:0:24952:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788925275.360636:0:24952:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788925275.360654:0:24952:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470845568:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788925275.360714:0:24952:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925275.360747:0:24952:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a502592d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788925275.362133:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845568 00000100:00100000:2.0:1788925275.362144:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845568 00000100:00100000:2.0:1788925275.362200:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788925275.362220:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470845568:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788925275.362252:0:22625:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788925275.362266:0:22625:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788925275.381602:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1788925275.386012:0:22625:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788925275.386059:0:22625:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788925275.386322:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:24952:x1875823470845568:12345-0@lo:253:mount.lustre.0 Request processed in 24100us (25603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925275.386332:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788925275.386470:0:24952:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:6380dc84-8626-4009-8bc6-29a71e76153e:24952:1875823470845568:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788925275.386483:0:24952:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788925275.386494:0:24952:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788925275.386496:0:24952:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788925275.386497:0:24952:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788925275.386498:0:24952:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788925275.386500:0:24952:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788925275.386501:0:24952:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788925275.386502:0:24952:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788925275.386504:0:24952:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788925275.386505:0:24952:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788925275.386519:0:24952:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788925275.387654:0:22648:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788925275.387660:0:22648:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788925275.387679:0:22648:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387707:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387715:0:22648:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387723:0:22648:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387757:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387772:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 23 pid: 22627 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925275.387795:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470845696:0@lo:104: 00000100:00100000:3.0:1788925275.387843:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925275.387933:0:22648:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925275.387942:0:22648:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 23 pid: 22625 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925275.387952:0:22648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470845824:0@lo:104: 00000100:00100000:3.0:1788925275.387973:0:22648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:0.0:1788925275.389138:0:24952:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1788925275.391338:0:24952:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788925275.391345:0:24952:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788925275.391379:0:24952:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788925275.391447:0:24952:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788925275.391465:0:24952:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788925275.391481:0:24952:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788925275.392382:0:24952:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788925275.392632:0:24952:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788925275.403151:0:22648:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6048ed000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925275.403511:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845696 00000100:00100000:1.0:1788925275.403521:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845696 00000100:00100000:1.0:1788925275.403567:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845824 00000100:00100000:1.0:1788925275.403570:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845824 00000100:00100000:1.0:1788925275.403589:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925275.403597:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470845696:12345-0@lo:104: 00010000:00010000:1.0:1788925275.403613:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.403700:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788925275.403706:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:22648:x1875823470845696:12345-0@lo:104: Request processed in 110us (15864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925275.403713:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925275.403730:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925275.403736:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470845824:12345-0@lo:104: 00010000:00010000:1.0:1788925275.403744:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.403777:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788925275.403782:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:22648:x1875823470845824:12345-0@lo:104: Request processed in 46us (15808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925275.403798:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788925275.408763:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788925275.408774:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408798:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ce00 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925275.408802:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408811:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925275.408819:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925275.408823:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925275.408865:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408872:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925275.408899:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408906:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a61858ce00/0x45e32cfaf7423d1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d21 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408925:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925275.408928:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408933:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858c400 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925275.408936:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408942:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925275.408948:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925275.408953:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788925275.408966:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408972:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925275.408985:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.408991:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a61858c400/0x45e32cfaf7423d0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423d13 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.409004:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925275.409005:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925275.409007:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925275.409013:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925275.409601:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470845952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925275.409664:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.409716:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470846080:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925275.409737:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925275.409769:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470845952 00000100:00100000:0.0:1788925275.409776:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470845952 00010000:00010000:0.0:1788925275.409813:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 24 pid: 22627 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925275.409839:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846080 00000100:00100000:0.0:1788925275.409843:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846080 00010000:00010000:0.0:1788925275.409855:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 25 pid: 22625 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925275.409868:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925275.409875:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+25:3622:x1875823470845952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925275.409888:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925275.409893:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 25 pid: 22627 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.409903:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 25 pid: 22627 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.409919:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925275.409951:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+25:3622:x1875823470845952:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.409957:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925275.409975:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925275.409981:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3623:x1875823470846080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925275.409995:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925275.409999:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 24 pid: 22625 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410007:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 24 pid: 22625 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410019:0:22620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410027:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788925275.410042:0:22620:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.022382572s 00010000:00010000:0.0:1788925275.410047:0:22620:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410053:0:22620:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410059:0:22620:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410065:0:22620:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410070:0:22620:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925275.410074:0:22620:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410081:0:22620:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410095:0:22620:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925275.410104:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925275.410131:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010af480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3623:x1875823470846080:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925275.410137:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788925275.410173:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470845952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925275.410196:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470846080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925275.413068:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c437a00/0x45e32cfaf7423d21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423d1a expref: 23 pid: 22627 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925275.413086:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470845696:0@lo:104: 00010000:00010000:1.0:1788925275.413100:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06400/0x45e32cfaf7423d13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423d0c expref: 22 pid: 22625 timeout: 761 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925275.413109:0:22648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489ad80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22648:1875823470845824:0@lo:104: 00010000:00010000:1.0:1788925275.413130:0:22648:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.413139:0:22648:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.413145:0:22648:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925275.413151:0:22648:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06c00/0x45e32cfaf7423e86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22648 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.394642:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788925276.523343:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925276.523351:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a503ad9800 from 14 10000000:01000000:0.0:1788925276.523356:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925276.523399:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.523438:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.523450:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925276.523474:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846208:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925276.523539:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925276.523595:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60489e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925276.523770:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846208 00000100:00100000:1.0:1788925276.523778:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846208 00000100:00100000:1.0:1788925276.523841:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788925276.523850:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470846208:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925276.523862:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925276.523887:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c437600/0x45e32cfaf7423e94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423e8d expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.523909:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c437600/0x45e32cfaf7423e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423e8d expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.523934:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c437600/0x45e32cfaf7423e94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e8d expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.523942:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c437600, rc 0) 00000100:00100000:1.0:1788925276.523977:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470846208:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925276.523983:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788925276.528549:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846208:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925276.528597:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e94 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.528626:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423e94 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925276.528695:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846336:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788925276.528757:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925276.528807:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60489e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925276.529128:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846336 00000100:00100000:1.0:1788925276.529137:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846336 00000100:00100000:1.0:1788925276.529193:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788925276.529203:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470846336:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788925276.529223:0:22625:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788925276.529240:0:22625:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788925276.529243:0:22625:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788925276.529330:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470846336:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 128us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925276.529338:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788925276.529496:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846336:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788925276.529563:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788925276.529948:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e94 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.529961:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61fde1200/0x45e32cfaf7423e8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423e94 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925276.529972:0:22630:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788925276.529975:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97a62e331000 from 14 10000000:01000000:0.0:1788925276.529978:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788925276.530003:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.530012:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.530022:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925276.530039:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788925276.530084:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925276.530121:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60489e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925276.530182:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846464 00000100:00100000:1.0:1788925276.530187:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846464 00000100:00100000:1.0:1788925276.530223:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788925276.530231:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470846464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925276.530241:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925276.530254:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a63c436000/0x45e32cfaf7423ea2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7423e9b expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.530276:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a63c436000/0x45e32cfaf7423ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7423e9b expref: 24 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.530298:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a63c436000/0x45e32cfaf7423ea2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e9b expref: 24 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925276.530307:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a63c436000, rc 0) 00000100:00100000:1.0:1788925276.530338:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eeca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470846464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925276.530345:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788925276.531056:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925276.531074:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423ea2 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925276.531084:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7423ea2 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925276.531139:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846592:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788925276.531179:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925276.531207:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60489e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788925276.531266:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846592 00000100:00100000:1.0:1788925276.531272:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846592 00000100:00100000:1.0:1788925276.531309:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788925276.531316:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470846592:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788925276.531332:0:22627:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788925276.531348:0:22627:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788925276.531351:0:22627:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1788925276.531460:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470846592:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925276.531467:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788925276.532773:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470846592:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788925276.532855:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788925276.532865:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423ea2 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925276.532947:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a61fde0600/0x45e32cfaf7423e9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7423ea2 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1788925276.600803:0:25020:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788925276.601631:0:25020:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788925276.848657:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470846720:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788925276.848723:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925276.848770:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846720 00000100:00100000:1.0:1788925276.848788:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846720 00000100:00100000:1.0:1788925276.848831:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788925276.848840:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470846720:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788925276.848866:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788925276.848905:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470846720:12345-0@lo:13:osp-pre-0-1.0 Request processed in 67us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925276.848921:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788925276.848965:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470846720:0@lo:13:osp-pre-0-1.0 00010000:00010000:2.0:1788925277.419894:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925277.866690:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925277.866713:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470846848:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925277.866795:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925277.866841:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846848 00000100:00100000:0.0:1788925277.866849:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846848 00000100:00100000:0.0:1788925277.866896:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925277.866904:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470846848:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788925277.866936:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925277.866978:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470846848:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925277.866984:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788925277.867029:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470846848:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925277.869746:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788925277.869769:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470846976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925277.870038:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925277.875137:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470846976 00000100:00100000:0.0:1788925277.875160:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470846976 00000100:00100000:0.0:1788925277.875232:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788925277.875243:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470846976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788925277.875266:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925277.875347:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470846976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (5309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925277.875354:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788925277.876073:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925277.876128:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470846976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788925278.381783:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470847104:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925278.381860:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925278.382355:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847104 00000100:00100000:0.0:1788925278.382365:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847104 00000100:00100000:0.0:1788925278.382454:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788925278.382464:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470847104:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925278.382634:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925278.382699:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470847104:12345-0@lo:41:osp-pre-1-0.0 Request processed in 237us (839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925278.382707:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788925278.382797:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470847104:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788925278.444147:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788925279.019460:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788925279.475434:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925280.427768:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470847232:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.427845:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.427951:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847232 00000100:00100000:1.0:1788925280.427960:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847232 00000100:00100000:1.0:1788925280.428011:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788925280.428020:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:3624:x1875823470847232:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788925280.428267:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925280.428272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925280.428285:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925280.428296:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff97a5039bb000 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925280.428318:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a60489aa00 x1875823470847616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788925280.428948:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:3624:x1875823470847232:12345-0@lo:400:kworker.0 Request processed in 925us (1100us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925280.428958:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788925280.429001:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470847744:0@lo:400:kworker.0 00000100:00100000:1.0:1788925280.429038:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.431904:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847744 00000100:00100000:2.0:1788925280.431918:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847744 00000100:00100000:2.0:1788925280.431987:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788925280.431998:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470847744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.432235:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875823470847744:12345-0@lo:400:kworker.0 Request processed in 239us (3196us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.432243:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788925280.432291:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a60489b800 x1875823470847744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925280.432305:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875823470847744:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.432423:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470847232:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.432523:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470847360:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.432570:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.432606:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925280.432613:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470847488:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.432639:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.432669:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470847616:0@lo:8:kworker.0 00000100:00100000:3.0:1788925280.432692:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788925280.432750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788925280.432754:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788925280.432757:0:37:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788925280.432777:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff97a501e69800 using connection 192.168.206.151@tcp/0@lo 00000100:00100000:3.0:1788925280.432787:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470848000:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.432812:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.432855:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff97a604898e00 x1875823470848128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788925280.432875:0:3620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470848128:0@lo:8:kworker.0 00000100:00100000:3.0:1788925280.432897:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.432936:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470848256:0@lo:400:kworker.0 00000100:00100000:3.0:1788925280.432959:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.432986:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848256 00000100:00100000:3.0:1788925280.433001:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848256 00000100:00100000:3.0:1788925280.433031:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788925280.433038:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470848256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.433224:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847488 00000100:00100000:0.0:1788925280.433228:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847488 00000100:00100000:0.0:1788925280.433261:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847616 00000100:00100000:0.0:1788925280.433264:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847616 00000100:00100000:0.0:1788925280.433273:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848000 00000100:00100000:0.0:1788925280.433276:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848000 00000100:00100000:0.0:1788925280.433287:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848128 00000100:00100000:0.0:1788925280.433289:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848128 00000100:00100000:0.0:1788925280.433298:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925280.433311:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470847488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.433375:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847360 00000100:00100000:2.0:1788925280.433379:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847360 00000100:00100000:2.0:1788925280.433430:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925280.433437:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470847360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.436535:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470847488:12345-0@lo:400:kworker.0 Request processed in 3215us (3886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.436551:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788925280.436585:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925280.436596:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470848000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.436648:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470848000:12345-0@lo:400:kworker.0 Request processed in 57us (3835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.436655:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788925280.436669:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925280.436674:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470847616:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788925280.436703:0:24139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:0.0:1788925280.436735:0:24139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x45e32cfaf7423ea9 00002000:00100000:0.0:1788925280.436749:0:24139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff97a503825000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788925280.436754:0:24139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788925280.436757:0:24139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788925280.436955:0:24139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788925280.436981:0:24139:0:(import.c:65:import_set_state_nolock()) ffff97a503826000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925280.437028:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3620:x1875823470847616:12345-0@lo:8:kworker.0 Request processed in 351us (4333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.437035:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788925280.437050:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788925280.437055:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3620:x1875823470848128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788925280.437098:0:24139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 666 last 0 00000020:00000080:0.0:1788925280.437117:0:24139:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x45e32cfaf7423eb0 00002000:00100000:0.0:1788925280.437135:0:24139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff97a503825800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:0.0:1788925280.437139:0:24139:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:0.0:1788925280.437141:0:24139:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788925280.437164:0:24139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:0.0:1788925280.437176:0:24139:0:(import.c:65:import_set_state_nolock()) ffff97a503824800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925280.437207:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1875823470848128:12345-0@lo:8:kworker.0 Request processed in 151us (4308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.437214:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788925280.437247:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925280.437285:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470848000:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.437299:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470847488:0@lo:400:kworker.0 00010000:00080000:0.0:1788925280.437332:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a604898e00 x1875823470848128/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925280.437344:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1788925280.437351:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788925280.437356:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788925280.437359:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a501e69800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788925280.437376:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788925280.437381:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604898e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3620:1875823470848128:0@lo:8:kworker.0 00010000:00080000:0.0:1788925280.437393:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a60489aa00 x1875823470847616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788925305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788925280.437426:0:3620:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788925280.437432:0:3620:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788925280.437435:0:3620:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788925280.437436:0:3620:0:(import.c:65:import_set_state_nolock()) ffff97a5039bb000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788925280.437454:0:3620:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788925280.437458:0:3620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3620:1875823470847616:0@lo:8:kworker.0 00000004:00080000:0.0:1788925280.437506:0:23376:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788925280.437527:0:23376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470848512:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788925280.437561:0:23376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925280.437581:0:23376:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a635827780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925280.437593:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848512 00000100:00100000:0.0:1788925280.437600:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848512 00000100:00100000:0.0:1788925280.437632:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788925280.437639:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23376:x1875823470848512:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:0.0:1788925280.437866:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925280.437884:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470847872:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.437916:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925280.437938:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788925280.437943:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470848384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925280.437964:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925280.437987:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470847872 00000100:00100000:0.0:1788925280.437992:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470847872 00000100:00100000:0.0:1788925280.438011:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925280.438017:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470847872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.438057:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470847872:12345-0@lo:400:kworker.0 Request processed in 40us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.438063:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788925280.438081:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848384 00000100:00100000:0.0:1788925280.438084:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848384 00000100:00100000:0.0:1788925280.438104:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788925280.438109:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875823470848384:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788925280.438131:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925280.438164:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3624:x1875823470848384:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925280.438169:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788925280.438198:0:3624:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5010aed80 x1875823470848384/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925280.438213:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470848384:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925280.438222:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470847872:0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.442010:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470847360:12345-0@lo:400:kworker.0 Request processed in 8563us (9430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.442024:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000004:00080000:2.0:1788925280.442080:0:23375:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788925280.442182:0:23375:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 666607779878ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788925280.442190:0:23375:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1788925280.442254:0:22659:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788925280.442279:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22659:1875823470848768:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788925280.442319:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.442344:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a324540 going to sleep for 11 seconds 00000004:00080000:2.0:1788925280.442358:0:22658:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788925280.442420:0:22658:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 666608017665ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788925280.442435:0:22658:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788925280.442451:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925280.442461:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470848640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925280.442492:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.442521:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848768 00000100:00100000:2.0:1788925280.442528:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848768 00000100:00100000:2.0:1788925280.442583:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925280.442592:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22659:x1875823470848768:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:2.0:1788925280.442645:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788925280.442679:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a604899f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470847360:0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.442705:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848640 00000100:00100000:2.0:1788925280.442709:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848640 00000100:00100000:2.0:1788925280.442734:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788925280.442741:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875823470848640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925280.442753:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925280.442808:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3623:x1875823470848640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.442815:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788925280.442848:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5041cc380 x1875823470848640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925280.442864:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470848640:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788925280.444495:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a60489b800 x1875823470848256/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925280.444510:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470848256:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.444562:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925280.444570:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470848896:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.444612:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925280.444657:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470849024:0@lo:400:kworker.0 00000100:00100000:0.0:1788925280.444677:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.445073:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470848896 00000100:00100000:2.0:1788925280.445080:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470848896 00000100:00100000:2.0:1788925280.445128:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849024 00000100:00100000:2.0:1788925280.445131:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849024 00000100:00100000:2.0:1788925280.445145:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925280.445152:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470848896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445207:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470848896:12345-0@lo:400:kworker.0 Request processed in 54us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.445214:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788925280.445230:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788925280.445236:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470849024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445264:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470849024:12345-0@lo:400:kworker.0 Request processed in 29us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.445271:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788925280.445290:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470849152:0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445319:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.445338:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788925280.445344:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a61043b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470849280:0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445367:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.445387:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849152 00000100:00100000:2.0:1788925280.445391:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849152 00000100:00100000:2.0:1788925280.445432:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849280 00000100:00100000:2.0:1788925280.445434:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849280 00000100:00100000:2.0:1788925280.445447:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925280.445452:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470849152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445482:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470849152:12345-0@lo:400:kworker.0 Request processed in 30us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.445487:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788925280.445496:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788925280.445502:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470849280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925280.445522:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470849280:12345-0@lo:400:kworker.0 Request processed in 20us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925280.445535:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1788925280.445560:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a61043b100 x1875823470849280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925280.445570:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a61043b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470849280:0@lo:400:kworker.0 00010000:00080000:2.0:1788925280.445578:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a610439f80 x1875823470849152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925280.445585:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470849152:0@lo:400:kworker.0 00002000:00080000:1.0:1788925280.446543:0:24139:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788925280.446549:0:24139:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788925280.446609:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23376:x1875823470848512:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8967us (9044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925280.446618:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788925280.446675:0:23376:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5010adf80 x1875823470848512/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788925296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925280.446686:0:23376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010adf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470848512:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788925280.446698:0:23376:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788925280.446738:0:23376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470849408:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788925280.446780:0:23376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.446800:0:23376:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6183750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925280.446815:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849408 00000100:00100000:1.0:1788925280.446820:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849408 00000100:00100000:1.0:1788925280.446853:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788925280.446859:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23376:x1875823470849408:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788925280.446877:0:24137:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:1.0:1788925280.446905:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23376:x1875823470849408:12345-0@lo:5:osp-pre-1-1.0 Request processed in 46us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925280.446910:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788925280.446940:0:23376:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a502830380 x1875823470849408/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788925296 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925280.446948:0:23376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470849408:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788925280.446955:0:23376:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788925280.446975:0:23376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470849536:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788925280.446995:0:23376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925280.447008:0:23376:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6183750c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925280.447505:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849536 00000100:00100000:1.0:1788925280.447511:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849536 00000100:00100000:1.0:1788925280.447539:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788925280.447546:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23376:x1875823470849536:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788925280.447572:0:24139:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:3.0:1788925280.447866:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470848256:12345-0@lo:400:kworker.0 Request processed in 14826us (14903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.447875:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788925280.448910:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925280.448917:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788925280.448956:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62e350e00 x1875823470849024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925280.448970:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470849024:0@lo:400:kworker.0 00010000:00080000:0.0:1788925280.448987:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5010aed80 x1875823470848896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925296 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925280.449007:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470848896:0@lo:400:kworker.0 00002000:00080000:3.0:1788925280.453035:0:24138:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788925280.453045:0:24138:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788925280.453052:0:24138:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:2.0:1788925280.460930:0:23364:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1788925280.461841:0:22612:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788925280.484821:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.484835:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.484859:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.484864:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.484870:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.484889:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.484899:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.484907:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.484932:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788925280.487741:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.487753:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.487780:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.487785:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.487791:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.487806:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.487828:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.487836:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.488533:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788925280.488929:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925280.488936:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.488946:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437a00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.488951:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.488960:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.488978:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.488985:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009be46d7a/0x45e32cfaf7423eb7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489007:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.489017:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489024:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.489027:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489035:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489047:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489054:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076680554/0x45e32cfaf7423ebe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.489068:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.489070:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.489072:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.489079:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.491684:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.499560:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.499581:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.499598:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.499602:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.499609:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.499632:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.499642:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.499651:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.499679:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788925280.499716:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925280.499724:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.499735:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925280.499740:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.499751:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.499780:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.499789:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc508e88/0x45e32cfaf7423ec5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.499814:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.499823:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.499825:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.502369:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.502383:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.502398:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.502420:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.502426:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.502441:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.502451:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.502470:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.502498:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.502517:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.502526:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.502536:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.502542:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.502552:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.502572:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.502580:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afd1bb09/0x45e32cfaf7423ecc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.502610:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.502612:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.502614:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.503646:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.503657:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.503670:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.503674:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.503680:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.503691:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.503700:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.503708:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.503733:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.503779:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.503786:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.503797:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.503801:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.503812:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.503826:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.503835:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae8d65a5/0x45e32cfaf7423ed3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.503852:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.503854:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.503856:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.504457:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.504465:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.504480:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.504484:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.504489:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.504499:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.504507:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.504515:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.504531:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.505079:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.505101:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505125:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.505130:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505140:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505155:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505163:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c4d83d2/0x45e32cfaf7423eda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505182:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.505184:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.505185:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788925280.505343:0:24953:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:3.0:1788925280.505356:0:24953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788925280.505360:0:24953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788925280.505619:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23376:x1875823470849536:12345-0@lo:5:osp-pre-1-1.0 Request processed in 58070us (58619us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788925280.505629:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00002000:00010000:1.0:1788925280.505685:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.505693:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.505704:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.505707:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.505712:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.505721:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.505740:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.505747:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.505776:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.505835:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.505841:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505861:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.505865:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505882:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505895:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505903:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8f7c2c/0x45e32cfaf7423ee1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.505920:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.505922:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.505924:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925280.506374:0:23376:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:3.0:1788925280.506383:0:23376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502830380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23376:1875823470849536:0@lo:5:osp-pre-1-1.0 00000004:00080000:3.0:1788925280.506479:0:23376:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788925280.506924:0:23376:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23376:1875823470849664:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788925280.506971:0:23376:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925280.507042:0:23376:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60a324000 going to sleep for 11 seconds 00000100:00100000:3.0:1788925280.507082:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849664 00000100:00100000:3.0:1788925280.507089:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849664 00000100:00100000:3.0:1788925280.507139:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788925280.507149:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23376:x1875823470849664:12345-0@lo:900:osp-pre-1-1.0 00002000:00010000:1.0:1788925280.507159:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.507169:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.507182:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.507187:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.507193:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.507205:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.507214:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.507222:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925280.507242:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23376:x1875823470849664:12345-0@lo:900:osp-pre-1-1.0 Request processed in 95us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.507251:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788925280.507252:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00080000:2.0:1788925280.507308:0:23376:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a5041cdf80 x1875823470849664/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788925296 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925280.507321:0:23376:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23376:1875823470849664:0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788925280.507348:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.507354:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.507363:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.507367:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.507382:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.507398:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.509025:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000666843d5/0x45e32cfaf7423ee8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.509055:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.509058:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.509061:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.514667:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.514867:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.514886:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.514890:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.514897:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.514911:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.514922:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.514930:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.514956:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.515099:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.515106:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.515116:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.515121:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.515131:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.515148:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.515166:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c089076/0x45e32cfaf7423eef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.515185:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.515187:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.515189:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925280.516254:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.516264:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.516278:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.516283:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.516289:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.516302:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.516311:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.516319:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.516429:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788925280.519989:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.520018:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.520036:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.520041:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.520048:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.520065:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.520077:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.520086:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.520165:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925280.520173:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.520182:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166dc00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925280.520187:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.520197:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.520215:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.520230:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b10a2558/0x45e32cfaf7423ef6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.521735:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788925280.521997:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788925280.522006:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.522019:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:2.0:1788925280.522023:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.522033:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.522058:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.522066:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423efd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.522086:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.522088:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.525101:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.529770:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.530047:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.530059:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530077:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.530090:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.530097:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530112:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530124:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530133:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530159:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788925280.530781:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.530789:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530799:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.530802:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.530807:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.530817:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.531772:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.531795:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.531825:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788925280.533020:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788925280.533032:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533043:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925280.533048:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533059:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533080:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533087:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000edce1ba/0x45e32cfaf7423f04 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533107:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925280.533111:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533131:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23a00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925280.533134:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533142:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533154:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533160:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c22e665/0x45e32cfaf7423f0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.533173:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.533176:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.533177:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.533504:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788925280.534683:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788925280.534694:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.534708:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=666s v=(0 0) 00010000:00010000:1.0:1788925280.534713:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925280.534719:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.534732:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.534742:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.534750:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.535873:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788925280.536546:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925280.536556:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.536569:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925280.536574:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.536584:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.536613:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.536621:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf7423f12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.536642:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.536644:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.536646:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925280.537374:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.537384:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.537398:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.537490:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.537497:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.537512:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.537523:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.537531:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.537623:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788925280.538883:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.538894:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.538907:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.538912:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.538918:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.538931:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.538940:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.538947:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540081:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925280.540098:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540111:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.540115:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540124:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540143:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540150:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf85b93/0x45e32cfaf7423f19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540174:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.540237:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540246:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.540250:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540257:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540279:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.540287:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.540289:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.540291:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788925280.540352:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788925280.540358:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a446817/0x45e32cfaf7423f20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.540378:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925280.541952:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.541965:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.542050:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.542054:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.542060:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.542074:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.542082:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.542095:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.542110:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925280.542125:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.542132:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.542140:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.542144:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.542152:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.542167:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.542173:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d783ab04/0x45e32cfaf7423f27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.543095:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.543099:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.543101:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925280.543145:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.543154:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543165:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.543169:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.543174:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543186:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543206:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543213:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543268:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925280.543342:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925280.543348:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.543356:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925280.543360:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.543368:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.543383:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.543391:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4306743/0x45e32cfaf7423f2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.543426:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.543428:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.543429:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788925280.543681:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788925280.543687:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543695:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=666s v=(0 0) 00010000:00010000:2.0:1788925280.543698:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925280.543702:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543711:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543719:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543725:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925280.543809:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788925280.548718:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.548731:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.548750:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.548755:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.548771:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.548786:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.548797:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.548804:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.548898:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925280.548906:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.548915:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166d400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.548920:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.548928:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.548944:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.548952:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc5fbd12/0x45e32cfaf7423f35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.549647:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.549653:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.549662:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.549666:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.549674:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.549701:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.549710:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.549712:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.549715:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.549869:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788925280.549875:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788925280.550614:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.550622:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.550634:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.550639:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.550645:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.550656:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.550664:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.550672:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.550775:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.550782:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.550790:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.550793:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.550802:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.550817:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.550826:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.550828:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.550829:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.550944:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788925280.550950:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062e6bfa3/0x45e32cfaf7423f43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788925280.551365:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.551371:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.551381:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.551384:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.551388:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.551397:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.551435:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.551441:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.551520:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.551527:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.551547:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.551551:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.551559:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.551582:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.551593:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.551594:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.551596:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.551701:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788925280.551706:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068eeaab7/0x45e32cfaf7423f4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788925280.552152:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.552158:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.552181:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.552185:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.552191:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.552202:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.552210:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.552218:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.552314:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.552321:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.552328:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.552331:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.552338:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.552349:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.552364:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.552365:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.552367:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.552497:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788925280.552502:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000042ab655d/0x45e32cfaf7423f51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788925280.552996:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.553004:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.553015:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.553018:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.553022:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.553044:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.553053:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.553060:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.558546:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.558559:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.558573:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06c00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.558578:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.558590:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.558610:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.558636:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.558638:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.558640:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925280.563994:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788925280.564007:0:24138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ef83af0c/0x45e32cfaf7423f58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.564487:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925280.565252:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.565261:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.565277:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.565282:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.565288:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.565302:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.565327:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.565335:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.565361:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925280.565499:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925280.565507:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.565527:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925280.565531:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.565540:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.565557:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.565564:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a76aef38/0x45e32cfaf7423f5f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.565589:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.565591:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.565593:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925280.566117:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.566124:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.566135:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.566138:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.566143:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.566153:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.566160:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.566167:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.566200:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925280.567120:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925280.567129:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788925280.567133:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.567139:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567140:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925280.567145:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567148:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.567152:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788925280.567154:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567157:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567166:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567173:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567176:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567181:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567184:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046c96111/0x45e32cfaf7423f66 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.567193:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925280.567199:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925280.567201:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567207:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f07400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925280.567210:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567216:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567225:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567232:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1af42b5/0x45e32cfaf7423f6d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.567243:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.567245:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.567252:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.567311:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925280.569636:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.569650:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.569666:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.569678:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.569684:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.569700:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.569710:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.569717:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.569743:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788925280.569871:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925280.569878:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.569885:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984600 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925280.569889:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.569898:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.569915:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.569922:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000199bec95/0x45e32cfaf7423f74 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925280.569941:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.569943:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925280.569945:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925280.572114:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.572127:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.572142:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.572147:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.572152:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.572166:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.572176:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.572191:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.572204:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788925280.573218:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.573228:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.573239:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984000 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.573252:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.573262:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.573283:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.573290:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bac67899/0x45e32cfaf7423f7b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.573313:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.573315:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.573317:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788925280.573510:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.573517:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.573527:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.573531:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.573536:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.573546:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.573555:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.573563:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.573592:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788925280.575174:0:24138:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788925280.575185:0:24138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.575953:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=666s v=(0 0) 00010000:00010000:3.0:1788925280.575965:0:24138:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925280.575972:0:24138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.575987:0:24138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.575997:0:24138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.576004:0:24138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925280.576063:0:24138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788925280.576144:0:24138:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:3.0:1788925280.576238:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22659:x1875823470848768:12345-0@lo:5:osp-pre-1-0.0 Request processed in 133645us (133916us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925280.576248:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788925280.576302:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22659:1875823470848768:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788925280.576317:0:22659:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:3.0:1788925280.578821:0:22659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60489ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22659:1875823470849792:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788925280.578907:0:22659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925280.578952:0:22659:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a618276540 going to sleep for 11 seconds 00000100:00100000:3.0:1788925280.578989:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849792 00000100:00100000:3.0:1788925280.578996:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849792 00000100:00100000:3.0:1788925280.579045:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925280.579054:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22659:x1875823470849792:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788925280.579094:0:24138:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:1.0:1788925280.586301:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925280.586313:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586327:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984200 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.586332:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586342:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586361:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586375:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1402248/0x45e32cfaf7423f82 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586437:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788925280.586441:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586447:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925280.586450:0:22622:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586458:0:22622:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586469:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586476:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006a73a2e6/0x45e32cfaf7423f89 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24138 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925280.586489:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.586491:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925280.586493:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925280.587165:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22659:x1875823470849792:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8108us (8254us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788925280.587175:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788925280.590682:0:22659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60489ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22659:1875823470849792:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788925280.590701:0:22659:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00010000:00010000:0.0:1788925280.591941:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925281.515420:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925281.965226:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925281.965248:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470849920:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788925281.965310:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925281.965846:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470849920 00000100:00100000:2.0:1788925281.965865:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470849920 00000100:00100000:2.0:1788925281.965917:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788925281.965925:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470849920:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925281.965952:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925281.965996:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610439500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470849920:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925281.966003:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788925281.966153:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470849920:0@lo:13:osp-pre-0-1.0 00000001:02000400:1.0:1788925282.272787:0:25310:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg651-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788925282.539567:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925282.988594:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470850048:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925282.988678:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925282.988734:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850048 00000100:00100000:0.0:1788925282.988741:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850048 00000100:00100000:0.0:1788925282.988795:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925282.988803:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470850048:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788925282.988835:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925282.988878:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470850048:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925282.988885:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788925282.988929:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470850048:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925282.992006:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470850176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925282.992080:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925282.992133:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850176 00000100:00100000:2.0:1788925282.992140:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850176 00000100:00100000:2.0:1788925282.992209:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925282.992219:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470850176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925282.992240:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925282.992278:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470850176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925282.992284:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788925282.992303:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925282.993257:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5041cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470850176:0@lo:13:osp-pre-0-0.0 00000020:00000004:3.0:1788925283.206357:0:25362:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788925283.206714:0:25362:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788925283.498673:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470850304:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788925283.498763:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925283.498976:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850304 00000100:00100000:0.0:1788925283.498984:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850304 00000100:00100000:0.0:1788925283.499036:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788925283.499045:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470850304:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925283.499077:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925283.499209:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470850304:12345-0@lo:41:osp-pre-1-0.0 Request processed in 165us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925283.499216:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788925283.499599:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470850304:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788925283.562973:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788925284.011340:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1788925284.261060:0:25412:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788925284.261343:0:25412:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788925284.586855:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925284.601910:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.602096:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338048 00000100:00100000:0.0:1788925284.602106:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338048 00000100:00100000:0.0:1788925284.602155:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:0.0:1788925284.602163:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2386:x1875823462338048:12345-192.168.206.51@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788925284.602188:0:22626:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 518e9438-b998-428e-81a8-4598516dcc95@192.168.206.51@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:0.0:1788925284.602215:0:22626:0:(genops.c:1384:class_connect()) connect: client 518e9438-b998-428e-81a8-4598516dcc95, cookie 0x45e32cfaf7423f90 00000100:00080000:0.0:1788925284.602574:0:22626:0:(import.c:65:import_set_state_nolock()) ffff97a503827800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788925284.603341:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+5:2386:x1875823462338048:12345-192.168.206.51@tcp:250:mount.lustre.0 Request processed in 1173us (1436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925284.603365:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 117 00000100:00100000:3.0:1788925284.618005:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.619752:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338176 00000100:00100000:1.0:1788925284.619765:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338176 00000100:00100000:1.0:1788925284.619907:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:1.0:1788925284.619929:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+5:18068:x1875823462338176:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788925284.619946:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925284.619964:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a503b23600/0x45e32cfaf7423f97 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3659 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.619994:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a503b23600/0x45e32cfaf7423f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3659 expref: 6 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.620006:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a503b23600/0x45e32cfaf7423f97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3659 expref: 6 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.620015:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23600, rc 0) 00000100:00100000:1.0:1788925284.620078:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+6:18068:x1875823462338176:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 162us (2160us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.620085:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 118 00000100:00100000:2.0:1788925284.626884:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.626980:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338304 00000100:00100000:0.0:1788925284.626990:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338304 00000100:00100000:0.0:1788925284.627057:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:0.0:1788925284.627070:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+6:18068:x1875823462338304:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788925284.627194:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+6:18068:x1875823462338304:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 127us (317us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788925284.627202:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 119 00000100:00100000:2.0:1788925284.640767:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.644627:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338432 00000100:00100000:1.0:1788925284.644644:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338432 00000100:00100000:1.0:1788925284.644777:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:1.0:1788925284.644788:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+6:18068:x1875823462338432:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788925284.644804:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925284.644823:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a503b23e00/0x45e32cfaf7423f9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3660 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.644875:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a503b23e00/0x45e32cfaf7423f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3660 expref: 7 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.644886:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a503b23e00/0x45e32cfaf7423f9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3660 expref: 7 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925284.644897:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23e00, rc 0) 00000100:00100000:1.0:1788925284.644966:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+7:18068:x1875823462338432:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 180us (4206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.644973:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 120 00000100:00100000:3.0:1788925284.653094:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.653279:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338560 00000100:00100000:1.0:1788925284.653290:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338560 00000100:00100000:1.0:1788925284.653517:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:1.0:1788925284.653527:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+7:18068:x1875823462338560:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788925284.653791:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eeca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+8:18068:x1875823462338560:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 264us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.653799:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 121 00000100:00100000:2.0:1788925284.668095:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.668303:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338688 00000100:00100000:1.0:1788925284.668314:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338688 00000100:00100000:1.0:1788925284.668372:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:1.0:1788925284.668381:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62eec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+8:18068:x1875823462338688:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788925284.668577:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62eec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+8:18068:x1875823462338688:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 195us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.668584:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 122 00000100:00100000:2.0:1788925284.675134:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.677053:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338816 00000100:00100000:1.0:1788925284.677094:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338816 00000100:00100000:1.0:1788925284.677182:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:1.0:1788925284.677193:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462338816:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788925284.677458:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462338816:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 213us (2286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.677692:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 123 00000100:00100000:3.0:1788925284.722082:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.722324:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462338944 00000100:00100000:0.0:1788925284.722337:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462338944 00000100:00100000:0.0:1788925284.722441:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:0.0:1788925284.722454:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462338944:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925284.722691:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462338944:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 239us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925284.722700:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 124 00000100:00100000:3.0:1788925284.730075:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.730317:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339072 00000100:00100000:1.0:1788925284.730328:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339072 00000100:00100000:1.0:1788925284.730387:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:1.0:1788925284.730397:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462339072:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788925284.730595:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+8:18087:x1875823462339072:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 198us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.730603:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 125 00000100:00100000:3.0:1788925284.738065:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.738388:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339200 00000100:00100000:2.0:1788925284.738398:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339200 00000100:00100000:2.0:1788925284.738503:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:2.0:1788925284.738513:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+8:18068:x1875823462339200:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788925284.738530:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925284.738548:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166c800/0x45e32cfaf7423fa5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3691 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.738575:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166c800/0x45e32cfaf7423fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3691 expref: 9 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.738587:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166c800/0x45e32cfaf7423fa5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3691 expref: 9 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.738595:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166c800, rc 0) 00000100:00100000:2.0:1788925284.740294:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+9:18068:x1875823462339200:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 1774us (2229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.740306:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 126 00000100:00100000:3.0:1788925284.744691:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.744838:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339328 00000100:00100000:0.0:1788925284.744849:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339328 00000100:00100000:0.0:1788925284.744910:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:0.0:1788925284.744931:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+9:18068:x1875823462339328:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788925284.744958:0:22626:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788925284.744982:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788925284.744987:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788925284.744991:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788925284.744993:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788925284.744996:0:22626:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788925284.749270:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62181e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+9:18068:x1875823462339328:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 4333us (4570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925284.749285:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 127 00000100:00100000:3.0:1788925284.760765:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.761055:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339456 00000100:00100000:2.0:1788925284.761076:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339456 00000100:00100000:2.0:1788925284.761137:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:2.0:1788925284.761148:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+9:18068:x1875823462339456:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788925284.761165:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925284.761181:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3698 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.761209:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 10 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.761220:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 10 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925284.761228:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166d800, rc 0) 00000100:00100000:2.0:1788925284.761284:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+10:18068:x1875823462339456:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 137us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.761290:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 128 00000100:00100000:3.0:1788925284.765231:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.765477:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339584 00000100:00100000:0.0:1788925284.765489:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339584 00000100:00100000:0.0:1788925284.765549:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:0.0:1788925284.765559:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+10:18068:x1875823462339584:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788925284.765713:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+10:18068:x1875823462339584:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 156us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925284.765721:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 129 00000100:00100000:2.0:1788925284.770269:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.770348:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339712 00000100:00100000:1.0:1788925284.770357:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339712 00000100:00100000:1.0:1788925284.770442:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:1.0:1788925284.770452:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+10:18068:x1875823462339712:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788925284.770581:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+10:18068:x1875823462339712:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 131us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.770589:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 130 00000100:00100000:3.0:1788925284.781272:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.781498:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339840 00000100:00100000:2.0:1788925284.781508:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339840 00000100:00100000:2.0:1788925284.781579:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:2.0:1788925284.781590:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+10:18094:x1875823462339840:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788925284.781754:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+10:18094:x1875823462339840:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 166us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.781763:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 131 00000100:00100000:3.0:1788925284.794508:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.799817:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462339968 00000100:00100000:2.0:1788925284.799833:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462339968 00000100:00100000:2.0:1788925284.799905:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:2.0:1788925284.799916:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+10:18094:x1875823462339968:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788925284.800085:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+10:18094:x1875823462339968:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 170us (5586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.800094:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 132 00000100:00100000:0.0:1788925284.804086:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.804159:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340096 00000100:00100000:2.0:1788925284.804169:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340096 00000100:00100000:0.0:1788925284.804179:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.804237:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340352 00000100:00100000:1.0:1788925284.804241:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340352 00000100:00100000:1.0:1788925284.804295:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:1.0:1788925284.804302:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1875823462340352:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788925284.804344:0:22633:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:1.0:1788925284.804429:0:22633:0:(genops.c:1384:class_connect()) connect: client 6568d3b8-2ff7-4199-8339-dd9864737580, cookie 0x45e32cfaf7423fb3 00000004:00100000:1.0:1788925284.804452:0:22633:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788925284.804657:0:22633:0:(import.c:65:import_set_state_nolock()) ffff97a5038d0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925284.804734:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:2386:x1875823462340352:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 430us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.804752:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1788925284.805686:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:2.0:1788925284.805694:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1875823462340096:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788925284.805716:0:23891:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp t0 exp 0000000000000000 cur 670 last 0 00000020:00000080:2.0:1788925284.805773:0:23891:0:(genops.c:1384:class_connect()) connect: client 6568d3b8-2ff7-4199-8339-dd9864737580, cookie 0x45e32cfaf7423fba 00000004:00100000:2.0:1788925284.805793:0:23891:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788925284.805967:0:23891:0:(import.c:65:import_set_state_nolock()) ffff97a62f51a000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925284.806027:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+6:2386:x1875823462340096:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 332us (1949us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.806035:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1788925284.809156:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.810090:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340480 00000100:00100000:1.0:1788925284.810103:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340480 00000100:00080000:0.0:1788925284.810246:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788925284.810507:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:1.0:1788925284.810518:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:0:x1875823462340480:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788925284.810570:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788925284.810649:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610439c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:0:x1875823462340480:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 133us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.810657:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1788925284.815022:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925284.815434:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340608 00000100:00100000:3.0:1788925284.815443:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340608 00000100:00100000:0.0:1788925284.815675:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925284.815700:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340224 00000100:00100000:0.0:1788925284.815704:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340224 00000100:00080000:2.0:1788925284.815819:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925284.816102:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1788925284.816115:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18068:x1875823462340608:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788925284.816150:0:22632:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925284.816234:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18068:x1875823462340608:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 122us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.818380:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1788925284.818425:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+7:0:x1875823462340224:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788925284.818455:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788925284.818524:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+7:0:x1875823462340224:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 130us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925284.818531:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:3.0:1788925284.821086:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1788925284.821599:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925284.821663:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340736 00000100:00100000:2.0:1788925284.821673:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340736 00000100:00100000:2.0:1788925284.821719:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1788925284.821729:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462340736:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788925284.821819:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462340736:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 92us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.821826:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:1.0:1788925284.837510:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925284.837578:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925284.837581:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341120 00000100:00100000:3.0:1788925284.837593:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341120 00000100:00100000:1.0:1788925284.837624:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925284.837670:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1788925284.837682:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462341120:12345-192.168.206.51@tcp:900:mount.lustre.0 00000100:00100000:3.0:1788925284.837777:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462341120:12345-192.168.206.51@tcp:900:mount.lustre.0 Request processed in 96us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925284.837785:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1788925284.837873:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340864 00000100:00100000:2.0:1788925284.837891:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340864 00000100:00100000:2.0:1788925284.837923:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462340992 00000100:00100000:2.0:1788925284.837925:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462340992 00000100:00100000:2.0:1788925284.837943:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1788925284.837949:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875823462340864:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788925284.837974:0:24139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1788925284.838004:0:24139:0:(genops.c:1384:class_connect()) connect: client 6568d3b8-2ff7-4199-8339-dd9864737580, cookie 0x45e32cfaf7423fc1 00002000:00100000:2.0:1788925284.838015:0:24139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6568d3b8-2ff7-4199-8339-dd9864737580/ffff97a62f51b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788925284.838032:0:24139:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788925284.838193:0:24139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788925284.838220:0:24139:0:(import.c:65:import_set_state_nolock()) ffff97a62f519800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925284.838249:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+6:2386:x1875823462340864:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 300us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.838256:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1788925284.838270:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:2.0:1788925284.838275:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1875823462340992:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788925284.838290:0:24139:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp t0 exp 0000000000000000 cur 671 last 0 00000020:00000080:2.0:1788925284.838304:0:24139:0:(genops.c:1384:class_connect()) connect: client 6568d3b8-2ff7-4199-8339-dd9864737580, cookie 0x45e32cfaf7423fc8 00002000:00100000:2.0:1788925284.838309:0:24139:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6568d3b8-2ff7-4199-8339-dd9864737580/ffff97a62f51b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788925284.838319:0:24139:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788925284.838452:0:24139:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788925284.838467:0:24139:0:(import.c:65:import_set_state_nolock()) ffff97a62f51a800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925284.838491:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+6:2386:x1875823462340992:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 214us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925284.838497:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1788925284.844911:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925284.845078:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341248 00000100:00100000:3.0:1788925284.845087:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341248 00000100:00100000:3.0:1788925284.845138:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1788925284.845148:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462341248:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00080000:0.0:1788925284.846962:0:22635:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1733us 00000004:00200000:3.0:1788925284.879159:0:22635:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788925284.879278:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:18068:x1875823462341248:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 34126us (34371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925284.879289:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1788925285.024861:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925285.025084:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341376 00000100:00100000:2.0:1788925285.025094:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341376 00000100:00100000:2.0:1788925285.025152:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1788925285.025161:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:18117:x1875823462341376:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:2.0:1788925285.025179:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925285.025201:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d400/0x45e32cfaf7423fcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f36c9 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925285.025790:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925285.025805:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925285.025819:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925285.026208:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788925285.026214:0:22632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788925285.026591:0:22632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925285.027095:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d400/0x45e32cfaf7423fcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f36c9 expref: 8 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925285.027121:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f36c9 expref: 7 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925285.027130:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:3.0:1788925285.027144:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925285.027148:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166d200, rc 0) 00000100:00100000:3.0:1788925285.027236:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18117:x1875823462341376:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 2076us (2385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.029870:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1788925285.546913:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470850688:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.546941:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470850560:0@lo:400:kworker.0 00000100:00100000:2.0:1788925285.547218:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470850432:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.547515:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470850816:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.549788:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925285.552041:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470851072:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552103:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925285.552139:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470851584:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552166:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925285.552204:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470852096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925285.552464:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925285.552508:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850560 00000100:00100000:0.0:1788925285.552516:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850560 00000100:00100000:0.0:1788925285.552552:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851072 00000100:00100000:0.0:1788925285.552555:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851072 00000100:00100000:0.0:1788925285.552570:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788925285.552577:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470850560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552640:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470850560:12345-0@lo:400:kworker.0 Request processed in 63us (2858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925285.552647:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788925285.552662:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788925285.552668:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470851072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552697:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470851072:12345-0@lo:400:kworker.0 Request processed in 30us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925285.552703:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788925285.552796:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470850560:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552806:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470851072:0@lo:400:kworker.0 00000100:00100000:0.0:1788925285.552857:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852096 00000100:00100000:0.0:1788925285.552861:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852096 00000100:00100000:0.0:1788925285.552893:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925285.552898:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470852096:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788925285.554634:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.554782:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470851200:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.554828:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.554845:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470851712:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.554939:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.555042:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470852224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788925285.555071:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.555117:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850688 00000100:00100000:1.0:1788925285.555125:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850688 00000100:00100000:1.0:1788925285.555174:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851200 00000100:00100000:1.0:1788925285.555177:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851200 00000100:00100000:1.0:1788925285.555197:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925285.555205:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470850688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555473:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470850688:12345-0@lo:400:kworker.0 Request processed in 267us (843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.555481:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788925285.555500:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925285.555507:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470851200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555536:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470851200:12345-0@lo:400:kworker.0 Request processed in 31us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.555542:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788925285.555577:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470850688:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555587:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470851200:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555634:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851584 00000100:00100000:1.0:1788925285.555638:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851584 00000100:00100000:1.0:1788925285.555663:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851712 00000100:00100000:1.0:1788925285.555666:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851712 00000100:00100000:1.0:1788925285.555682:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925285.555688:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470851584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555720:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470851584:12345-0@lo:400:kworker.0 Request processed in 33us (3554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.555725:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788925285.555751:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788925285.555757:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470851712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.555788:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470851712:12345-0@lo:400:kworker.0 Request processed in 32us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.555794:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1788925285.555822:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a63f7b6a00 x1875823470851712/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925285.555833:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470851712:0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.557021:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470851584:0@lo:400:kworker.0 00002000:00000024:0.0:1788925285.557094:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925285.557159:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470852096:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4261us (4694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925285.557167:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925285.557188:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852224 00000100:00100000:0.0:1788925285.557199:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852224 00000100:00100000:0.0:1788925285.557347:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925285.557354:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875823470852224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788925285.557372:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925285.557420:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3623:x1875823470852224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (2348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925285.557426:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925285.557461:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470852096:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925285.557514:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470852224:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788925285.557545:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925285.557550:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925285.557553:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925285.557555:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1788925285.562798:0:24953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6568d3b8-2ff7-4199-8339-dd9864737580 00000001:00080000:0.0:1788925285.562817:0:24953:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788925285.566873:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.566990:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850432 00000100:00100000:1.0:1788925285.567000:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850432 00000100:00100000:1.0:1788925285.567057:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788925285.567068:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3621:x1875823470850432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.567149:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3621:x1875823470850432:12345-0@lo:400:kworker.0 Request processed in 83us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.567156:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788925285.567493:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925285.567576:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470851328:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.567606:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925285.567664:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1875823470851840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.567694:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925285.567719:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851840 00000100:00100000:3.0:1788925285.567724:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851840 00000100:00100000:3.0:1788925285.567777:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788925285.567783:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875823470851840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925285.567793:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470850432:0@lo:400:kworker.0 00000100:00100000:2.0:1788925285.567801:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470850944:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.567814:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875823470851840:12345-0@lo:400:kworker.0 Request processed in 32us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925285.567824:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925285.567832:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788925285.567843:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470851456:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.567844:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850944 00000100:00100000:3.0:1788925285.567847:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850944 00000100:00100000:2.0:1788925285.567863:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925285.567879:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851456 00000100:00100000:3.0:1788925285.567882:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851456 00000100:00100000:2.0:1788925285.567883:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788925285.567889:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470850944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.567895:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788925285.567900:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470851456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.570266:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3621:x1875823470851456:12345-0@lo:400:kworker.0 Request processed in 2357us (2393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925285.570279:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788925285.570376:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470850816 00000100:00100000:1.0:1788925285.570384:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470850816 00000100:00100000:1.0:1788925285.570443:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851328 00000100:00100000:1.0:1788925285.570446:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851328 00000100:00100000:1.0:1788925285.570467:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925285.570474:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470850816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.570528:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470850816:12345-0@lo:400:kworker.0 Request processed in 55us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.570534:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788925285.570544:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925285.570549:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470851328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.570568:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470851328:12345-0@lo:400:kworker.0 Request processed in 20us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.570573:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788925285.570622:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925285.570762:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3624:1875823470851840:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.570788:0:3624:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788925285.570806:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470850816:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.570817:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470851328:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.571965:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3621:1875823470851456:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.572039:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470851968:0@lo:400:kworker.0 00000100:00100000:3.0:1788925285.572092:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925285.572292:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470851968 00000100:00100000:1.0:1788925285.572298:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470851968 00000100:00100000:1.0:1788925285.572526:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788925285.572535:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875823470851968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925285.572587:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1875823470851968:12345-0@lo:400:kworker.0 Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925285.572594:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788925285.572639:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788925285.572697:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a63f7b4a80 x1875823470851968/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788925285.572710:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3621:1875823470851968:0@lo:400:kworker.0 00000100:00100000:2.0:1788925285.584747:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470850944:12345-0@lo:400:kworker.0 Request processed in 16839us (16903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925285.584761:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788925285.587425:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470850944:0@lo:400:kworker.0 00010000:00010000:1.0:1788925285.612213:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925286.637000:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925287.082864:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925287.093283:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470852352:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788925287.093359:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925287.093755:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852352 00000100:00100000:2.0:1788925287.093764:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852352 00000100:00100000:2.0:1788925287.093839:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788925287.093850:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470852352:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925287.093904:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925287.093969:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470852352:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.093976:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788925287.094138:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470852352:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788925287.094271:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925287.406596:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.406705:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341504 00000100:00100000:3.0:1788925287.406715:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341504 00000100:00100000:3.0:1788925287.406826:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:3.0:1788925287.406836:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:18169:x1875823462341504:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:3.0:1788925287.406870:0:23891:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788925287.406946:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:18169:x1875823462341504:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 111us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925287.406953:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00080000:0.0:1788925287.407279:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788925287.416544:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.416635:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341632 00000100:00100000:1.0:1788925287.416644:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341632 00000100:00100000:1.0:1788925287.416714:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00080000:0.0:1788925287.416821:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788925287.416942:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+6:18169:x1875823462341632:12345-192.168.206.51@tcp:41:lfs.0 00000004:00000024:1.0:1788925287.416976:0:22634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788925287.417061:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+6:18169:x1875823462341632:12345-192.168.206.51@tcp:41:lfs.0 Request processed in 121us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925287.420886:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.421158:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341760 00000100:00100000:0.0:1788925287.421167:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341760 00000100:00100000:0.0:1788925287.421249:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:0.0:1788925287.421260:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6568d3b8-2ff7-4199-8339-dd9864737580+6:18169:x1875823462341760:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:0.0:1788925287.421298:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925287.421373:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6568d3b8-2ff7-4199-8339-dd9864737580+6:18169:x1875823462341760:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 115us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.421381:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00080000:2.0:1788925287.421736:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925287.424202:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.424561:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462341888 00000100:00100000:2.0:1788925287.424570:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462341888 00000100:00100000:2.0:1788925287.424641:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1788925287.424651:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6568d3b8-2ff7-4199-8339-dd9864737580+5:18169:x1875823462341888:12345-192.168.206.51@tcp:13:lfs.0 00002000:00000024:2.0:1788925287.424683:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925287.424775:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6568d3b8-2ff7-4199-8339-dd9864737580+5:18169:x1875823462341888:12345-192.168.206.51@tcp:13:lfs.0 Request processed in 126us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.424782:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00080000:0.0:1788925287.424942:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925287.426490:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:2.0:1788925287.603488:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.603812:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342016 00000100:00100000:1.0:1788925287.603822:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342016 00000100:00100000:1.0:1788925287.603879:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:1.0:1788925287.603890:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+10:18200:x1875823462342016:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788925287.603906:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925287.603925:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a503b22000/0x45e32cfaf7423fdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f36d0 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925287.603954:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a503b22000/0x45e32cfaf7423fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f36d0 expref: 11 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925287.603966:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a503b22000/0x45e32cfaf7423fdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f36d0 expref: 11 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925287.603975:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22000, rc 0) 00000100:00100000:1.0:1788925287.604044:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635416050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342016:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 156us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.604051:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 134 00000100:00100000:3.0:1788925287.615617:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.615829:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342144 00000100:00100000:0.0:1788925287.615839:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342144 00000100:00100000:0.0:1788925287.615897:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:0.0:1788925287.615906:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342144:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788925287.616121:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342144:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 215us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.616129:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 135 00000100:00100000:3.0:1788925287.624429:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.624613:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342272 00000100:00100000:2.0:1788925287.624623:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342272 00000100:00100000:2.0:1788925287.624797:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1788925287.624809:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342272:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788925287.625002:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635415050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342272:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 194us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.625009:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 136 00000100:00100000:2.0:1788925287.657999:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.658112:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342400 00000100:00100000:1.0:1788925287.658123:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342400 00000100:00100000:1.0:1788925287.658184:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 137 00000100:00100000:1.0:1788925287.658194:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342400:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788925287.658360:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635414050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342400:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 166us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.658368:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 137 00010000:00010000:1.0:1788925287.661105:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925287.714357:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.714632:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342528 00000100:00100000:2.0:1788925287.714642:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342528 00000100:00100000:2.0:1788925287.714699:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:2.0:1788925287.714709:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342528:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788925287.715062:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a635417450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342528:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 352us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.715070:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 138 00000100:00100000:3.0:1788925287.719103:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.719489:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342656 00000100:00100000:0.0:1788925287.719501:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342656 00000100:00100000:0.0:1788925287.719606:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:0.0:1788925287.719617:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342656:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925287.719762:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+11:18207:x1875823462342656:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 147us (667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.719770:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 139 00000100:00100000:0.0:1788925287.727928:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.728029:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342784 00000100:00100000:2.0:1788925287.728039:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342784 00000100:00100000:2.0:1788925287.728085:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:2.0:1788925287.728094:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18200:x1875823462342784:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788925287.728109:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925287.728124:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166d400/0x45e32cfaf7423fe4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3701 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925287.728149:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166d400/0x45e32cfaf7423fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3701 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925287.728160:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166d400/0x45e32cfaf7423fe4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3701 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925287.728169:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166d400, rc 0) 00000100:00100000:2.0:1788925287.728237:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+12:18200:x1875823462342784:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 144us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.728244:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 140 00000100:00100000:3.0:1788925287.736641:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.736775:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462342912 00000100:00100000:0.0:1788925287.736785:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462342912 00000100:00100000:0.0:1788925287.736851:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:0.0:1788925287.736861:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+12:18200:x1875823462342912:12345-192.168.206.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788925287.736904:0:22626:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788925287.736921:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788925287.736926:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788925287.736929:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788925287.736932:0:22626:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788925287.736934:0:22626:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788925287.738702:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+12:18200:x1875823462342912:12345-192.168.206.51@tcp:256:mount.lustre.0 Request processed in 1833us (2061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.738715:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 141 00000100:00100000:1.0:1788925287.744162:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.744268:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343040 00000100:00100000:0.0:1788925287.744278:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343040 00000100:00100000:0.0:1788925287.744337:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:0.0:1788925287.744348:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+12:18200:x1875823462343040:12345-192.168.206.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788925287.744365:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925287.744384:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3708 expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925287.744453:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 13 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925287.744464:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 13 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925287.744473:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde1400, rc 0) 00000100:00100000:0.0:1788925287.744528:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:18200:x1875823462343040:12345-192.168.206.51@tcp:101:mount.lustre.0 Request processed in 183us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.744535:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 142 00000100:00100000:3.0:1788925287.746495:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.746630:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343168 00000100:00100000:0.0:1788925287.746653:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343168 00000100:00100000:0.0:1788925287.746705:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:0.0:1788925287.746714:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18200:x1875823462343168:12345-192.168.206.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788925287.746890:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18200:x1875823462343168:12345-192.168.206.51@tcp:501:mount.lustre.0 Request processed in 176us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.746897:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 143 00000100:00100000:3.0:1788925287.758538:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.758678:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343296 00000100:00100000:2.0:1788925287.758688:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343296 00000100:00100000:2.0:1788925287.758752:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1788925287.758762:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+13:18200:x1875823462343296:12345-192.168.206.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788925287.758917:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+13:18200:x1875823462343296:12345-192.168.206.51@tcp:503:mount.lustre.0 Request processed in 155us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.758925:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 144 00000100:00100000:2.0:1788925287.781736:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.782026:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343424 00000100:00100000:1.0:1788925287.782036:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343424 00000100:00100000:1.0:1788925287.782098:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:1.0:1788925287.782110:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:18213:x1875823462343424:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788925287.782297:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ecf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:18213:x1875823462343424:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 189us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.782305:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 145 00000100:00100000:3.0:1788925287.788858:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.788949:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343552 00000100:00100000:0.0:1788925287.788959:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343552 00000100:00100000:0.0:1788925287.789010:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:0.0:1788925287.789019:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18213:x1875823462343552:12345-192.168.206.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788925287.789178:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a603ece050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18213:x1875823462343552:12345-192.168.206.51@tcp:502:llog_process_th.0 Request processed in 159us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.789186:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 146 00000100:00100000:3.0:1788925287.793972:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.794060:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.798097:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.801692:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343680 00000100:00100000:1.0:1788925287.801707:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343680 00000100:00100000:3.0:1788925287.801773:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.801774:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343936 00000100:00100000:2.0:1788925287.801781:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343936 00000100:00100000:2.0:1788925287.801814:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344448 00000100:00100000:2.0:1788925287.801818:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344448 00000100:00100000:3.0:1788925287.801830:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.801847:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344320 00000100:00100000:2.0:1788925287.801851:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344320 00000100:00100000:3.0:1788925287.801857:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925287.801872:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1788925287.801883:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:2387:x1875823462344448:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925287.801957:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:2387:x1875823462344448:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (3868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.801964:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:2.0:1788925287.801981:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1788925287.801987:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:2387:x1875823462344320:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925287.802012:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:2387:x1875823462344320:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.802037:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:2.0:1788925287.802050:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:2.0:1788925287.802054:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1875823462343936:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788925287.802096:0:22632:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from e4daeccf-da8c-4c27-87be-e0bd110ac0bf@192.168.206.51@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:2.0:1788925287.802130:0:22632:0:(genops.c:1384:class_connect()) connect: client e4daeccf-da8c-4c27-87be-e0bd110ac0bf, cookie 0x45e32cfaf7423ff2 00000004:00100000:2.0:1788925287.802153:0:22632:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788925287.802245:0:22632:0:(import.c:65:import_set_state_nolock()) ffff97a62f51e800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925287.802273:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2386:x1875823462343936:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 216us (8212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.802281:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:1.0:1788925287.803013:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1788925287.803021:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2386:x1875823462343680:12345-192.168.206.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788925287.803042:0:23891:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from e4daeccf-da8c-4c27-87be-e0bd110ac0bf@192.168.206.51@tcp t0 exp 0000000000000000 cur 673 last 0 00000020:00000080:1.0:1788925287.803091:0:23891:0:(genops.c:1384:class_connect()) connect: client e4daeccf-da8c-4c27-87be-e0bd110ac0bf, cookie 0x45e32cfaf7423ff9 00000004:00100000:1.0:1788925287.803108:0:23891:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788925287.803172:0:23891:0:(import.c:65:import_set_state_nolock()) ffff97a5038d1000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788925287.803204:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2386:x1875823462343680:12345-192.168.206.51@tcp:38:mount.lustre.0 Request processed in 182us (9241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.803211:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:1.0:1788925287.803642:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344704 00000100:00100000:1.0:1788925287.803650:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344704 00000100:00100000:1.0:1788925287.804181:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344576 00000100:00100000:1.0:1788925287.804188:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344576 00000100:00100000:2.0:1788925287.806071:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:1.0:1788925287.806735:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1788925287.806754:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+6:2387:x1875823462344576:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925287.806828:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+6:2387:x1875823462344576:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 84us (4971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.806835:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1788925287.807000:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2387:x1875823462344704:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925287.807031:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2387:x1875823462344704:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 950us (5265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.807038:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1788925287.816342:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.816381:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.816450:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.816527:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344192 00000100:00100000:0.0:1788925287.816537:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344192 00000100:00100000:0.0:1788925287.816610:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344064 00000100:00100000:0.0:1788925287.816614:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344064 00000100:00100000:0.0:1788925287.816631:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462343808 00000100:00100000:0.0:1788925287.816633:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462343808 00000100:00100000:0.0:1788925287.816648:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1788925287.816656:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+7:18200:x1875823462344192:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788925287.816686:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925287.816763:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+7:18200:x1875823462344192:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.816770:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1788925287.816798:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1788925287.816828:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:0:x1875823462344064:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788925287.816840:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925287.816865:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:0:x1875823462344064:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 40us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.816871:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1788925287.816883:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:0.0:1788925287.816890:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:0:x1875823462343808:12345-192.168.206.51@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788925287.816914:0:22633:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788925287.816946:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:0:x1875823462343808:12345-192.168.206.51@tcp:41:mount.lustre.0 Request processed in 56us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.816952:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00080000:3.0:1788925287.817227:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788925287.817232:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788925287.827943:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.828085:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344832 00000100:00100000:0.0:1788925287.828096:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344832 00000100:00100000:0.0:1788925287.828170:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:0.0:1788925287.828180:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462344832:12345-192.168.206.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788925287.828261:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462344832:12345-192.168.206.51@tcp:40:mount.lustre.0 Request processed in 82us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.828268:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:3.0:1788925287.840890:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.840933:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925287.840960:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925287.841099:0:22644:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345216 00000100:00100000:0.0:1788925287.841108:0:22644:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345216 00000100:00100000:0.0:1788925287.841165:0:22644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1788925287.841175:0:22644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462345216:12345-192.168.206.51@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788925287.841246:0:22644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462345216:12345-192.168.206.51@tcp:900:mount.lustre.0 Request processed in 73us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925287.841269:0:22644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:2.0:1788925287.841661:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462344960 00000100:00100000:2.0:1788925287.841667:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462344960 00000100:00100000:2.0:1788925287.841701:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345088 00000100:00100000:2.0:1788925287.841704:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345088 00000100:00100000:2.0:1788925287.841731:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1788925287.841737:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875823462344960:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788925287.841764:0:24137:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from e4daeccf-da8c-4c27-87be-e0bd110ac0bf@192.168.206.51@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:2.0:1788925287.841805:0:24137:0:(genops.c:1384:class_connect()) connect: client e4daeccf-da8c-4c27-87be-e0bd110ac0bf, cookie 0x45e32cfaf7424000 00002000:00100000:2.0:1788925287.841882:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e4daeccf-da8c-4c27-87be-e0bd110ac0bf/ffff97a62f51f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788925287.841900:0:24137:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788925287.841957:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788925287.841985:0:24137:0:(import.c:65:import_set_state_nolock()) ffff97a62f51d000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925287.842016:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2386:x1875823462344960:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 279us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.842023:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1788925287.842038:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1788925287.842042:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2386:x1875823462345088:12345-192.168.206.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788925287.842057:0:24137:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from e4daeccf-da8c-4c27-87be-e0bd110ac0bf@192.168.206.51@tcp t0 exp 0000000000000000 cur 674 last 0 00000020:00000080:2.0:1788925287.842072:0:24137:0:(genops.c:1384:class_connect()) connect: client e4daeccf-da8c-4c27-87be-e0bd110ac0bf, cookie 0x45e32cfaf7424007 00002000:00100000:2.0:1788925287.842078:0:24137:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e4daeccf-da8c-4c27-87be-e0bd110ac0bf/ffff97a62f518000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788925287.842084:0:24137:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:2.0:1788925287.842118:0:24137:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788925287.842130:0:24137:0:(import.c:65:import_set_state_nolock()) ffff97a62f51e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788925287.842149:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2386:x1875823462345088:12345-192.168.206.51@tcp:8:mount.lustre.0 Request processed in 105us (1188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925287.842156:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1788925287.849973:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925287.850128:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345344 00000100:00100000:1.0:1788925287.850141:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345344 00000100:00100000:1.0:1788925287.850192:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:1.0:1788925287.850202:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462345344:12345-192.168.206.51@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788925287.850283:0:22636:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788925287.850369:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18200:x1875823462345344:12345-192.168.206.51@tcp:33:mount.lustre.0 Request processed in 168us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925287.850376:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1788925288.106695:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470852480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925288.106781:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925288.107016:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852480 00000100:00100000:2.0:1788925288.107025:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852480 00000100:00100000:2.0:1788925288.107104:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788925288.107113:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470852480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925288.107136:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925288.107179:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470852480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925288.107186:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788925288.107529:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470852608:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788925288.107565:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925288.107642:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852608 00000100:00100000:2.0:1788925288.107647:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852608 00000100:00100000:2.0:1788925288.107683:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788925288.107691:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470852608:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788925288.107715:0:22638:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788925288.107772:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470852608:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925288.107779:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788925288.107982:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470852608:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1788925288.108049:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925288.108077:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470852480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925288.109531:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925288.109676:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345472 00000100:00100000:1.0:1788925288.109684:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345472 00000100:00100000:1.0:1788925288.109749:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:1.0:1788925288.109760:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18236:x1875823462345472:12345-192.168.206.51@tcp:101:mkdir.0 00010000:00010000:1.0:1788925288.109777:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925288.109797:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742400e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3739 expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.109872:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.109900:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.109914:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925288.109958:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788925288.109962:0:23891:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788925288.109982:0:23891:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.110010:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742400e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 8 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.110030:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 7 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925288.110039:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:1.0:1788925288.110043:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788925288.110046:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22200, rc 0) 00000100:00100000:1.0:1788925288.110101:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+7:18236:x1875823462345472:12345-192.168.206.51@tcp:101:mkdir.0 Request processed in 344us (579us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925288.110107:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:3.0:1788925288.618739:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470852736:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925288.618826:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925288.618925:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852736 00000100:00100000:0.0:1788925288.618933:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852736 00000100:00100000:0.0:1788925288.618990:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788925288.619000:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470852736:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925288.619030:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925288.619083:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470852736:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925288.619090:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788925288.619199:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470852736:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788925288.682655:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925289.261050:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788925289.714311:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925290.666734:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925290.666757:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470852864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925290.666834:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667153:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470853120:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667185:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667211:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470853632:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667249:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667266:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470854144:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667303:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667322:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788925290.667327:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470852992:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667352:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667373:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470853504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667395:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667446:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470854016:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667467:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925290.667497:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853120 00000100:00100000:1.0:1788925290.667505:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853120 00000100:00100000:1.0:1788925290.667543:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853632 00000100:00100000:1.0:1788925290.667546:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853632 00000100:00100000:1.0:1788925290.667562:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925290.667570:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470853120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667622:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470853120:12345-0@lo:400:kworker.0 Request processed in 52us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.667629:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925290.667647:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925290.667652:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470853632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667679:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470853632:12345-0@lo:400:kworker.0 Request processed in 27us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.667685:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925290.667702:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854144 00000100:00100000:1.0:1788925290.667715:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854144 00000100:00100000:1.0:1788925290.667753:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853504 00000100:00100000:1.0:1788925290.667756:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853504 00000100:00100000:1.0:1788925290.667764:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854016 00000100:00100000:1.0:1788925290.667766:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854016 00000100:00100000:1.0:1788925290.667778:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925290.667784:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470854144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667812:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875823470854144:12345-0@lo:400:kworker.0 Request processed in 30us (509us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.667818:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788925290.667828:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925290.667833:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470853504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667857:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470853504:12345-0@lo:400:kworker.0 Request processed in 24us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.667863:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788925290.667873:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925290.667879:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470854016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667901:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470854016:12345-0@lo:400:kworker.0 Request processed in 23us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.667906:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788925290.667951:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470853504:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667960:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470854016:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667967:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470853120:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.667975:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470853632:0@lo:400:kworker.0 00010000:00080000:1.0:1788925290.667985:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a63f7b5880 x1875823470854144/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925290.668007:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3622:1875823470854144:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.668523:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852864 00000100:00100000:2.0:1788925290.668528:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852864 00000100:00100000:2.0:1788925290.668553:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788925290.668561:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a61043b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470852864:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788925290.668581:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925290.668616:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a61043b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470852864:12345-0@lo:13:osp-pre-1-1.0 Request processed in 57us (1782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.668622:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788925290.668640:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470852992 00000100:00100000:2.0:1788925290.668643:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470852992 00000100:00100000:2.0:1788925290.668663:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788925290.668669:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3622:x1875823470852992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.668695:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3622:x1875823470852992:12345-0@lo:400:kworker.0 Request processed in 27us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.668701:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788925290.668753:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470852992:0@lo:400:kworker.0 00000100:00100000:2.0:1788925290.668764:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925290.668770:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470854528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788925290.668814:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925290.668837:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854528 00000100:00100000:2.0:1788925290.668841:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854528 00000100:00100000:2.0:1788925290.668869:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925290.668875:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470854528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788925290.668884:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:2.0:1788925290.668908:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470854528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 34us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925290.668914:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788925290.668938:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470854528:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788925290.669542:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788925290.669547:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925290.669549:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788925290.669564:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470853248:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669598:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669617:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470853760:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669635:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669651:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470854272:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669678:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669720:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470852864:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925290.669735:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788925290.669740:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470853376:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669759:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669775:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470853888:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669802:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669817:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470854400:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669837:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925290.669860:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853248 00000100:00100000:0.0:1788925290.669864:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853248 00000100:00100000:0.0:1788925290.669892:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853760 00000100:00100000:0.0:1788925290.669894:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853760 00000100:00100000:0.0:1788925290.669904:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853376 00000100:00100000:0.0:1788925290.669906:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853376 00000100:00100000:0.0:1788925290.669915:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925290.669921:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470853248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669953:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470853248:12345-0@lo:400:kworker.0 Request processed in 32us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925290.669958:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788925290.669968:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925290.669973:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60691c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470853760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.669993:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60691c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470853760:12345-0@lo:400:kworker.0 Request processed in 20us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925290.669998:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788925290.670093:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788925290.670104:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470853376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.670127:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470853376:12345-0@lo:400:kworker.0 Request processed in 24us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.670674:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854272 00000100:00100000:1.0:1788925290.670681:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854272 00000100:00100000:1.0:1788925290.670726:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470853888 00000100:00100000:1.0:1788925290.670730:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470853888 00000100:00100000:1.0:1788925290.670743:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854400 00000100:00100000:1.0:1788925290.670746:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854400 00000100:00100000:1.0:1788925290.670761:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925290.670769:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470854272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.670823:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470854272:12345-0@lo:400:kworker.0 Request processed in 55us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.670830:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788925290.670843:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925290.670849:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470853888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.670876:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470853888:12345-0@lo:400:kworker.0 Request processed in 28us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.670882:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788925290.670893:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788925290.670898:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470854400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.670925:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470854400:12345-0@lo:400:kworker.0 Request processed in 27us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925290.670931:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788925290.670967:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788925290.670970:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925290.670973:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788925290.671003:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470853376:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.671025:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470853888:0@lo:400:kworker.0 00010000:00080000:1.0:1788925290.671037:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a60913d500 x1875823470854400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788925290.671049:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470854400:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.671060:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470853248:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.671069:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470853760:0@lo:400:kworker.0 00000100:00100000:1.0:1788925290.671084:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470854272:0@lo:400:kworker.0 00000100:00100000:0.0:1788925290.671245:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000001:00100000:1.0:1788925290.679102:0:24133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e4daeccf-da8c-4c27-87be-e0bd110ac0bf 00000001:00100000:1.0:1788925290.679115:0:24133:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6568d3b8-2ff7-4199-8339-dd9864737580 00000001:00100000:3.0:1788925290.680161:0:23364:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e4daeccf-da8c-4c27-87be-e0bd110ac0bf 00000001:00100000:3.0:1788925290.680194:0:23364:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6568d3b8-2ff7-4199-8339-dd9864737580 00000001:00100000:2.0:1788925290.687372:0:22612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e4daeccf-da8c-4c27-87be-e0bd110ac0bf 00000001:00100000:2.0:1788925290.687386:0:22612:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6568d3b8-2ff7-4199-8339-dd9864737580 00010000:00010000:1.0:1788925290.731504:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788925291.542361:0:25511:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788925291.763230:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925292.202834:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925292.202857:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470854656:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788925292.202936:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925292.203137:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854656 00000100:00100000:2.0:1788925292.203145:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854656 00000100:00100000:2.0:1788925292.203211:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788925292.203221:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470854656:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925292.203247:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925292.203300:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470854656:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925292.203307:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925292.203421:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470854656:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788925292.203561:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788925292.779662:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925293.228067:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788925293.228090:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470854784:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788925293.228643:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788925293.228654:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470854912:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925293.228706:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925293.228747:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854912 00000100:00100000:3.0:1788925293.228754:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854912 00000100:00100000:3.0:1788925293.228818:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788925293.228827:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470854912:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925293.228856:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:3.0:1788925293.228858:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788925293.228887:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470854784 00000100:00100000:2.0:1788925293.228890:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470854784 00000100:00100000:3.0:1788925293.228901:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470854912:12345-0@lo:41:osp-pre-0-1.0 Request processed in 76us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925293.228907:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788925293.228932:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788925293.228939:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470854784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788925293.228953:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788925293.228963:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470854912:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925293.228985:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470854784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 48us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925293.228991:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1788925293.229006:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788925293.229030:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470854784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925293.288478:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288518:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288550:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288570:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288587:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288602:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288618:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288639:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288677:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925293.288721:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346112 00000100:00100000:0.0:1788925293.288730:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346112 00000100:00100000:0.0:1788925293.288780:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346624 00000100:00100000:0.0:1788925293.288783:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346624 00000100:00100000:0.0:1788925293.288797:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345984 00000100:00100000:0.0:1788925293.288799:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345984 00000100:00100000:0.0:1788925293.288815:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346496 00000100:00100000:0.0:1788925293.288817:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346496 00000100:00100000:0.0:1788925293.288833:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1788925293.288841:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462346112:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925293.288909:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462346112:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 69us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.288917:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1788925293.288946:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1788925293.288954:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2388:x1875823462346624:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925293.288979:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2388:x1875823462346624:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.288985:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:0.0:1788925293.288996:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1788925293.289002:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462345984:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925293.289024:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462345984:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.289029:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:0.0:1788925293.289039:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:0.0:1788925293.289044:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2388:x1875823462346496:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925293.289063:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2388:x1875823462346496:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 18us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925293.289068:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00080000:0.0:1788925293.289083:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925293.289088:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925293.289597:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345600 00000100:00100000:1.0:1788925293.289605:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345600 00000100:00100000:1.0:1788925293.289650:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1788925293.289658:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:2388:x1875823462345600:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.289711:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:2388:x1875823462345600:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 54us (1244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.289717:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 148 00000100:00100000:1.0:1788925293.289750:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345856 00000100:00100000:1.0:1788925293.289754:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345856 00000100:00100000:1.0:1788925293.289781:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346368 00000100:00100000:1.0:1788925293.289785:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346368 00000100:00100000:1.0:1788925293.289800:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462345728 00000100:00100000:1.0:1788925293.289802:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462345728 00000100:00100000:1.0:1788925293.289829:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346240 00000100:00100000:1.0:1788925293.289833:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346240 00000100:00100000:1.0:1788925293.289848:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1788925293.289854:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462345856:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.289884:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462345856:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 30us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.289891:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:1.0:1788925293.289903:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1788925293.289910:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2388:x1875823462346368:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.289933:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2388:x1875823462346368:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.289939:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:1.0:1788925293.289952:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1788925293.289958:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:2388:x1875823462345728:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.289984:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:2388:x1875823462345728:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 26us (1380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.289990:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:1.0:1788925293.290002:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:1.0:1788925293.290010:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2388:x1875823462346240:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925293.290034:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2388:x1875823462346240:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925293.290040:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00080000:1.0:1788925293.290138:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925293.290142:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788925293.740460:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470855040:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925293.740535:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925293.740591:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855040 00000100:00100000:3.0:1788925293.740599:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855040 00000100:00100000:3.0:1788925293.740644:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788925293.740654:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470855040:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788925293.740700:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788925293.740746:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470855040:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925293.740764:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788925293.740809:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470855040:0@lo:41:osp-pre-1-0.0 00000001:00100000:0.0:1788925293.746936:0:24953:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e4daeccf-da8c-4c27-87be-e0bd110ac0bf 00010000:00010000:0.0:1788925293.802784:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788925294.251384:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788925294.827096:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788925295.624942:0:25659:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffabd96ef0 20000000:00000080:0.0:1788925295.625028:0:25659:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff97a61fcf6000 uarg=0000000000000000 20000000:01000000:0.0:1788925295.625076:0:25659:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925295.625082:0:25659:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788925295.625088:0:25659:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788925295.631518:0:25660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788925295.631944:0:25659:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788925295.643810:0:25659:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788925295.644056:0:25659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644092:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 23 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644101:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644108:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644115:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644124:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644131:0:25659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644138:0:25659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644189:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 12 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644206:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 12 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644222:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855168:192.168.206.51@tcp:104: 00010000:00010000:1.0:1788925295.644326:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644341:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644349:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855296:192.168.206.51@tcp:104: 00010000:00010000:1.0:1788925295.644382:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 23 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644433:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 23 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644443:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855424:0@lo:104: 00000100:00100000:1.0:1788925295.644499:0:25659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925295.644538:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644546:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644554:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855552:0@lo:104: 00000100:00100000:1.0:1788925295.644573:0:25659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925295.644596:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644606:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644616:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855680:0@lo:104: 00000100:00100000:1.0:1788925295.644636:0:25659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788925295.644662:0:25659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 23 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.644670:0:25659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 23 pid: 22626 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.644677:0:25659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855808:0@lo:104: 00000100:00100000:1.0:1788925295.648328:0:25659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925295.648373:0:25659:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604c7c900 going to sleep for 11 seconds 00000100:00100000:1.0:1788925295.648558:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855552 00000100:00100000:1.0:1788925295.648566:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855552 00000100:00100000:1.0:1788925295.648605:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855680 00000100:00100000:1.0:1788925295.648608:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855680 00000100:00100000:1.0:1788925295.648633:0:22616:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855808 00000100:00100000:1.0:1788925295.648636:0:22616:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855808 00000100:00100000:1.0:1788925295.648649:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925295.648657:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+5:25659:x1875823470855552:12345-0@lo:104: 00010000:00010000:1.0:1788925295.648672:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.648745:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788925295.648751:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+5:25659:x1875823470855552:12345-0@lo:104: Request processed in 95us (4178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.648758:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788925295.648778:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925295.648783:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:25659:x1875823470855680:12345-0@lo:104: 00010000:00010000:1.0:1788925295.648791:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.648824:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788925295.648841:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+4:25659:x1875823470855680:12345-0@lo:104: Request processed in 58us (4204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.648848:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788925295.648875:0:22616:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925295.648881:0:22616:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:25659:x1875823470855808:12345-0@lo:104: 00010000:00010000:1.0:1788925295.648889:0:22616:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.648916:0:22616:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788925295.648921:0:22616:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:6380dc84-8626-4009-8bc6-29a71e76153e+3:25659:x1875823470855808:12345-0@lo:104: Request processed in 41us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.648926:0:22616:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788925295.648973:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855552:0@lo:104: 00000100:00100000:1.0:1788925295.648982:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855680:0@lo:104: 00000100:00100000:1.0:1788925295.648988:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855808:0@lo:104: 00010000:00010000:1.0:1788925295.649010:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788925295.649015:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649022:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a60166c200 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925295.649039:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649048:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925295.649055:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925295.649072:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788925295.649106:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649112:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788925295.649130:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649137:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a60166c200/0x45e32cfaf7423cbf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423cc6 expref: -99 pid: 24132 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649222:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788925295.649226:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649232:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c436800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:1.0:1788925295.649235:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649241:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788925295.649246:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925295.649251:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788925295.649264:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.649269:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788925295.650563:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925295.650586:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470855936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925295.650643:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788925295.650709:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788925295.650748:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855936 00000100:00100000:0.0:1788925295.650755:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855936 00010000:00010000:0.0:1788925295.650919:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 24 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925295.650948:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788925295.650954:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+24:3621:x1875823470855936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925295.650978:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925295.650982:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 24 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.650991:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 24 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.651006:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c436400/0x45e32cfaf7423cc6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423cbf expref: 24 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.651019:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925295.651050:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6380dc84-8626-4009-8bc6-29a71e76153e+23:3621:x1875823470855936:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.651056:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788925295.651092:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470855936:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925295.652325:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.652339:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c436800/0x45e32cfaf7423c80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c87 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.652355:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925295.652357:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925295.652359:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925295.652519:0:22617:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470855424 00000100:00100000:3.0:1788925295.652529:0:22617:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470855424 00000100:00100000:3.0:1788925295.652716:0:22617:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925295.652726:0:22617:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+3:25659:x1875823470855424:12345-0@lo:104: 00010000:00010000:3.0:1788925295.652739:0:22617:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.652814:0:22617:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788925295.652820:0:22617:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:6380dc84-8626-4009-8bc6-29a71e76153e+3:25659:x1875823470855424:12345-0@lo:104: Request processed in 97us (8321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.652826:0:22617:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788925295.652869:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470856064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788925295.652902:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788925295.653091:0:22622:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788925295.653097:0:22622:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.653105:0:22622:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a63c437000 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:3.0:1788925295.653108:0:22622:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.653117:0:22622:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925295.653120:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856064 00000100:00100000:2.0:1788925295.653125:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856064 10000000:00010000:3.0:1788925295.653134:0:22622:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788925295.653140:0:22622:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788925295.653143:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925295.653166:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925295.653172:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+23:3623:x1875823470856064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925295.653181:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925295.653185:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925295.653193:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925295.653209:0:22620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a63c437400/0x45e32cfaf7423c87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c80 expref: 23 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925295.653221:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925295.653252:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6380dc84-8626-4009-8bc6-29a71e76153e+22:3623:x1875823470856064:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925295.653267:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788925295.653303:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:6380dc84-8626-4009-8bc6-29a71e76153e:3623:1875823470856064:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788925295.653465:0:22622:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.653472:0:22622:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788925295.653485:0:22622:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.653491:0:22622:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a63c437000/0x45e32cfaf7423e40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423e47 expref: -99 pid: 24952 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.653500:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925295.653502:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925295.653503:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788925295.653989:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470856192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788925295.654028:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.654159:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856192 00000100:00100000:0.0:1788925295.654173:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856192 00010000:00010000:0.0:1788925295.654196:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 22 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925295.654226:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788925295.654234:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+22:3624:x1875823470856192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925295.654243:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925295.654247:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 22 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.654255:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 22 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.654269:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925295.654300:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+22:3624:x1875823470856192:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.654307:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788925295.654367:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:6380dc84-8626-4009-8bc6-29a71e76153e:3624:1875823470856192:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788925295.654474:0:25659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a501f06a00/0x45e32cfaf7423e47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423e40 expref: 21 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925295.654484:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855424:0@lo:104: 00010000:00010000:3.0:1788925295.656423:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925295.656429:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788925295.656432:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925295.656622:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00010000:00010000:0.0:1788925295.656717:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.656728:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a501f06800 already unused, calling callback (ffffffffc1151c20) 10000000:00010000:0.0:1788925295.656732:0:22621:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.656742:0:22621:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.656757:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925295.656859:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855168:192.168.206.51@tcp:104: 00000100:00100000:2.0:1788925295.656870:0:25659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25659:1875823470855296:192.168.206.51@tcp:104: 00010000:00010000:2.0:1788925295.656903:0:25659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788925295.657062:0:22621:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788925295.657069:0:22621:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788925295.657156:0:22621:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.657163:0:22621:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788925295.657190:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.657197:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.151@tcp lock: ffff97a501f06800/0x45e32cfaf7423c72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x45e32cfaf7423c79 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925295.657215:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925295.657217:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925295.657218:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925295.657225:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925295.657239:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470856320:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788925295.657279:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.657385:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346752 00000100:00100000:3.0:1788925295.657392:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346752 00010000:00010000:3.0:1788925295.657442:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 13 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925295.657467:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462346880 00000100:00100000:3.0:1788925295.657471:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462346880 00010000:00010000:3.0:1788925295.657481:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 14 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925295.657508:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1788925295.657515:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:518e9438-b998-428e-81a8-4598516dcc95+14:2387:x1875823462346752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925295.657526:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925295.657532:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 14 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657541:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 14 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657554:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a61fde1400/0x45e32cfaf7423feb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3708 expref: 14 pid: 22625 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657566:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925295.657605:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:518e9438-b998-428e-81a8-4598516dcc95+13:2387:x1875823462346752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 90us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.657612:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:3.0:1788925295.657645:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:3.0:1788925295.657651:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:518e9438-b998-428e-81a8-4598516dcc95+12:2387:x1875823462346880:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925295.657659:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925295.657664:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657671:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657692:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60166d800/0x45e32cfaf7423fac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3698 expref: 12 pid: 22627 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925295.657707:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925295.657726:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef21c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:518e9438-b998-428e-81a8-4598516dcc95+11:2387:x1875823462346880:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 75us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.657732:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:1.0:1788925295.659334:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856320 00000100:00100000:1.0:1788925295.659347:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856320 00010000:00010000:1.0:1788925295.659384:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 21 pid: 22626 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925295.659458:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788925295.659467:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+21:3622:x1875823470856320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788925295.659479:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925295.659484:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 21 pid: 22626 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659494:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 21 pid: 22626 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659510:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a60166c600/0x45e32cfaf7423c79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x45e32cfaf7423c72 expref: 21 pid: 22626 timeout: 781 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659526:0:22619:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659552:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659568:0:22619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659575:0:22619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659582:0:22619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659590:0:22619:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659596:0:22619:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22400 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:1.0:1788925295.659600:0:22619:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659609:0:22619:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659624:0:22619:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925295.659634:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925295.659873:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6380dc84-8626-4009-8bc6-29a71e76153e+20:3622:x1875823470856320:12345-0@lo:103:ldlm_bl.0 Request processed in 407us (2591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.659881:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788925295.660189:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:6380dc84-8626-4009-8bc6-29a71e76153e:3622:1875823470856320:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788925295.660330:0:25659:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925295.660340:0:25659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925295.660347:0:25659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff97a503b22400/0x45e32cfaf742401c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925295.786534:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925295.786555:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470856448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925295.786620:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.786817:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856448 00000100:00100000:3.0:1788925295.786825:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856448 00000100:00100000:3.0:1788925295.786870:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925295.786879:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470856448:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788925295.786904:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925295.786922:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470856576:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.786948:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.786956:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470856448:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.786963:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925295.786966:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470857088:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.786985:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.787018:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470857600:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787054:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787064:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856576 00000100:00100000:3.0:1788925295.787068:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856576 00000100:00100000:0.0:1788925295.787074:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788925295.787079:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470856704:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787090:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857088 00000100:00100000:3.0:1788925295.787092:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857088 00000100:00100000:0.0:1788925295.787101:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787105:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788925295.787111:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470856576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787115:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470857216:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787133:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787141:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470856576:12345-0@lo:400:kworker.0 Request processed in 30us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787147:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62e353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470857728:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787159:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788925295.787165:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787172:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788925295.787178:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470857088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787194:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470856576:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787203:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470857088:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787204:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502833480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470857088:12345-0@lo:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.787209:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788925295.787234:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857600 00000100:00100000:0.0:1788925295.787238:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857600 00000100:00100000:0.0:1788925295.787273:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857728 00000100:00100000:0.0:1788925295.787276:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857728 00000100:00100000:0.0:1788925295.787298:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788925295.787305:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470857600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787323:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788925295.787330:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470857728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787338:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875823470857600:12345-0@lo:400:kworker.0 Request processed in 35us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787344:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788925295.787358:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470857728:12345-0@lo:400:kworker.0 Request processed in 29us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787362:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856704 00000100:00100000:3.0:1788925295.787363:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788925295.787365:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856704 00000100:00100000:0.0:1788925295.787424:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857216 00000100:00100000:0.0:1788925295.787428:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857216 00000100:00100000:0.0:1788925295.787451:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925295.787456:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470856704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787496:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470856704:12345-0@lo:400:kworker.0 Request processed in 39us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787502:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788925295.787514:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925295.787520:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470857216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787546:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502832680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470857216:12345-0@lo:400:kworker.0 Request processed in 26us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787552:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788925295.787581:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470856960:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787603:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925295.787629:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470857472:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787649:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856960 00000100:00100000:0.0:1788925295.787649:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787652:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856960 00000100:00100000:0.0:1788925295.787667:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788925295.787671:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857472 00000100:00100000:3.0:1788925295.787673:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857472 00000100:00100000:0.0:1788925295.787673:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470856832:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787704:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788925295.787707:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787710:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470856960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787722:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470857344:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787738:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502830700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875823470856960:12345-0@lo:400:kworker.0 Request processed in 28us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787740:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787744:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788925295.787749:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470857856:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787752:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857344 00000100:00100000:3.0:1788925295.787755:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857344 00000100:00100000:0.0:1788925295.787766:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925295.787767:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788925295.787773:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470857472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.787783:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875823470856960:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787795:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875823470857472:12345-0@lo:400:kworker.0 Request processed in 23us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.787798:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3622:1875823470857472:0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787801:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788925295.787810:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857856 00000100:00100000:3.0:1788925295.787812:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857856 00000100:00100000:0.0:1788925295.787815:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788925295.787821:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470857344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787825:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788925295.787830:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470857856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788925295.787856:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875823470857856:12345-0@lo:400:kworker.0 Request processed in 26us (89us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.787870:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788925295.787889:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470856832 00000100:00100000:3.0:1788925295.787892:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470856832 00000100:00100000:3.0:1788925295.787912:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788925295.787918:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470856832:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788925295.788073:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788925295.788079:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788925295.788081:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788925295.788083:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925295.790581:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875823470857344:12345-0@lo:400:kworker.0 Request processed in 2750us (2830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925295.790596:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788925295.790703:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470856448:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925295.790724:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788925295.790735:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470857984:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925295.790787:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925295.790907:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470857984 00000100:00100000:1.0:1788925295.790916:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470857984 00000100:00100000:1.0:1788925295.790960:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788925295.790968:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875823470857984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925295.790989:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788925295.791032:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3621:x1875823470857984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925295.791038:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788925295.792925:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875823470856832:12345-0@lo:400:kworker.0 Request processed in 5000us (5209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925295.792938:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788925295.793055:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470856832:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.793071:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875823470857344:0@lo:400:kworker.0 00010000:00080000:0.0:1788925295.793086:0:3622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a502831c00 x1875823470857856/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925295.793096:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a502831c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3622:1875823470857856:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.793143:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470856704:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.793154:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470857216:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.793165:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e353480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470857728:0@lo:400:kworker.0 00010000:00080000:0.0:1788925295.793177:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62e350a80 x1875823470857600/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788925295.793185:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62e350a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3623:1875823470857600:0@lo:400:kworker.0 00000100:00100000:0.0:1788925295.793221:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470857984:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788925295.852936:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788925296.683214:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788925296.683222:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a6068ed800 from 13 10000000:01000000:2.0:1788925296.683229:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925296.683288:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.683300:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.683329:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925296.683355:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.683451:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925296.683484:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63581a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925296.683583:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858112 00000100:00100000:0.0:1788925296.683591:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858112 00000100:00100000:0.0:1788925296.683660:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788925296.683669:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+20:22630:x1875823470858112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925296.683693:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925296.683706:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a61fde0e00/0x45e32cfaf742402a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7424023 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925296.683729:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a61fde0e00/0x45e32cfaf742402a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7424023 expref: 21 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925296.683740:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a61fde0e00/0x45e32cfaf742402a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7424023 expref: 21 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925296.683748:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde0e00, rc 0) 00000100:00100000:0.0:1788925296.683796:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925296.683803:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788925296.685468:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925296.685494:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf742402a expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.685506:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf742402a expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925296.685593:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.685652:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925296.685701:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63581a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925296.686140:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858240 00000100:00100000:0.0:1788925296.686146:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858240 00000100:00100000:0.0:1788925296.686205:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788925296.686216:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925296.686351:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 137us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925296.686358:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788925296.686948:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.686993:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.687045:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925296.687082:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5010856c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925296.687122:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858368 00000100:00100000:1.0:1788925296.687128:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858368 00000100:00100000:1.0:1788925296.687167:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788925296.687175:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.687287:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 112us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925296.687294:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788925296.687449:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858368:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925296.688577:0:25674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788925296.689126:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788925296.689149:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788925296.689160:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf742402a expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.689171:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166d800/0x45e32cfaf7424023 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf742402a expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788925296.689181:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788925296.689183:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a503a1e000 from 13 10000000:01000000:2.0:1788925296.689198:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788925296.689240:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.689248:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.689258:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925296.689281:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.689337:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925296.689383:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63581a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788925296.689555:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858496 00000100:00100000:3.0:1788925296.689562:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858496 00000100:00100000:3.0:1788925296.689610:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788925296.689620:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+21:22630:x1875823470858496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788925296.689766:0:22626:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925296.689781:0:22626:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a62d984800/0x45e32cfaf7424038 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf7424031 expref: -99 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925296.689804:0:22626:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a62d984800/0x45e32cfaf7424038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf7424031 expref: 22 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925296.690017:0:22626:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a62d984800/0x45e32cfaf7424038 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf7424031 expref: 22 pid: 22626 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925296.690028:0:22626:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a62d984800, rc 0) 00000100:00100000:3.0:1788925296.690079:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 460us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925296.690086:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788925296.690223:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925296.690238:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424038 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.690247:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7424038 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925296.690304:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.690334:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925296.690364:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63581a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925296.690430:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858624 00000100:00100000:0.0:1788925296.690435:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858624 00000100:00100000:0.0:1788925296.690471:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788925296.690480:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858624:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925296.690586:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858624:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925296.690602:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788925296.690767:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858624:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.690797:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858752:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.693983:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925296.694043:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5010856c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925296.695395:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858752 00000100:00100000:2.0:1788925296.695443:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858752 00000100:00100000:2.0:1788925296.695498:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788925296.695508:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858752:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.695698:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858752:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1720us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925296.695715:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788925296.698745:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858752:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788925296.701620:0:25675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788925296.701880:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788925296.701902:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925296.701912:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424038 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.701923:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a60166c600/0x45e32cfaf7424031 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424038 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925296.701950:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925296.701953:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a503ad9800 from 13 10000000:01000000:1.0:1788925296.701955:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925296.701988:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.701996:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.702006:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925296.702027:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.702087:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925296.702129:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925296.702194:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470858880 00000100:00100000:2.0:1788925296.702201:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470858880 00000100:00100000:2.0:1788925296.702246:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788925296.702255:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+22:22630:x1875823470858880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925296.702267:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925296.702278:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166c200/0x45e32cfaf7424046 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf742403f expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.702300:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166c200/0x45e32cfaf7424046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf742403f expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.702309:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166c200/0x45e32cfaf7424046 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf742403f expref: 23 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.702317:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166c200, rc 0) 00000100:00100000:2.0:1788925296.702363:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470858880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925296.702370:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788925296.702555:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470858880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925296.702569:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424046 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.702578:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7424046 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925296.702645:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.702685:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925296.702706:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925296.702782:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859008 00000100:00100000:0.0:1788925296.702787:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859008 00000100:00100000:0.0:1788925296.702816:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788925296.702824:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470859008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925296.702940:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470859008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925296.702947:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788925296.703052:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.703083:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925296.703121:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925296.703146:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788925296.703194:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859136 00000100:00100000:2.0:1788925296.703199:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859136 00000100:00100000:2.0:1788925296.703230:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788925296.703238:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470859136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788925296.703321:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470859136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925296.703328:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788925296.703436:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef92300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859136:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925296.704332:0:25676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788925296.720378:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788925296.720437:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925296.720461:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424046 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.720473:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a503b23200/0x45e32cfaf742403f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424046 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788925296.720485:0:22630:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788925296.720487:0:22630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97a62e331000 from 13 10000000:01000000:1.0:1788925296.720490:0:22630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788925296.720523:0:22630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.720532:0:22630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.720543:0:22630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925296.720567:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.720639:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925296.720694:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe000 going to sleep for 11 seconds 00000100:00100000:2.0:1788925296.721140:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859264 00000100:00100000:2.0:1788925296.721157:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859264 00000100:00100000:2.0:1788925296.721205:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788925296.721213:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+23:22630:x1875823470859264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925296.721226:0:22625:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925296.721238:0:22625:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166dc00/0x45e32cfaf7424054 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x45e32cfaf742404d expref: -99 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.721260:0:22625:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166dc00/0x45e32cfaf7424054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x45e32cfaf742404d expref: 24 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.721270:0:22625:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166dc00/0x45e32cfaf7424054 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x45e32cfaf742404d expref: 24 pid: 22625 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925296.721278:0:22625:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166dc00, rc 0) 00000100:00100000:2.0:1788925296.721329:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470859264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925296.721336:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788925296.721480:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788925296.721508:0:22630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424054 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925296.721518:0:22630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x45e32cfaf7424054 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925296.721582:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788925296.721613:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925296.721638:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788925296.721796:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859392 00000100:00100000:1.0:1788925296.721801:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859392 00000100:00100000:1.0:1788925296.721823:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788925296.721830:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470859392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.721929:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470859392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925296.721936:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788925296.721973:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5039b3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.722015:0:22630:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.722053:0:22630:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925296.722071:0:22630:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63cefe000 going to sleep for 11 seconds 00000100:00100000:1.0:1788925296.722081:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859520 00000100:00100000:1.0:1788925296.722084:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859520 00000100:00100000:1.0:1788925296.722099:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788925296.722104:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470859520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925296.722180:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:22630:x1875823470859520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 74us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925296.722186:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788925296.722221:0:22630:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:6380dc84-8626-4009-8bc6-29a71e76153e:22630:1875823470859520:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788925296.730080:0:25677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788925296.730644:0:22630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788925296.730683:0:22630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788925296.730694:0:22630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424054 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925296.730705:0:22630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.151@tcp lock: ffff97a503b22600/0x45e32cfaf742404d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x45e32cfaf7424054 expref: -99 pid: 22630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925296.875510:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925297.257494:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.257589:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347008 00000100:00100000:2.0:1788925297.257598:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347008 00000100:00100000:2.0:1788925297.257658:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:2.0:1788925297.257667:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+11:18082:x1875823462347008:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788925297.257694:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.257712:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a60166c000/0x45e32cfaf742405b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3740 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.257743:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a60166c000/0x45e32cfaf742405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3740 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.257754:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a60166c000/0x45e32cfaf742405b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3740 expref: 12 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.257777:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a60166c000, rc 0) 00000100:00100000:2.0:1788925297.257848:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a6076d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347008:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 182us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.257855:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 161 00000100:00100000:1.0:1788925297.260706:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.260811:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347136 00000100:00100000:2.0:1788925297.260830:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347136 00000100:00100000:2.0:1788925297.260885:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:2.0:1788925297.260895:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347136:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788925297.261043:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347136:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 149us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.261050:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 162 00000100:00100000:1.0:1788925297.263074:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.263198:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347264 00000100:00100000:3.0:1788925297.263208:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347264 00000100:00100000:3.0:1788925297.263261:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:3.0:1788925297.263271:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347264:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788925297.263551:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347264:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 280us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925297.263567:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 163 00000100:00100000:0.0:1788925297.273680:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925297.274180:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347392 00000100:00100000:1.0:1788925297.274190:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347392 00000100:00100000:1.0:1788925297.274246:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1788925297.274255:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+12:18082:x1875823462347392:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788925297.274287:0:22627:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925297.274305:0:22627:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff97a503b23800/0x45e32cfaf7424062 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9632377f397f3747 expref: -99 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.274335:0:22627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff97a503b23800/0x45e32cfaf7424062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3747 expref: 13 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.274348:0:22627:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff97a503b23800/0x45e32cfaf7424062 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3747 expref: 13 pid: 22627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.274357:0:22627:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23800, rc 0) 00000100:00100000:1.0:1788925297.274571:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+13:18082:x1875823462347392:12345-192.168.206.51@tcp:101:ll_cfg_requeue.0 Request processed in 316us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925297.274578:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 164 00000100:00100000:1.0:1788925297.277144:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.277503:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347520 00000100:00100000:3.0:1788925297.277512:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347520 00000100:00100000:3.0:1788925297.277566:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:3.0:1788925297.278037:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18082:x1875823462347520:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788925297.278203:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:18082:x1875823462347520:12345-192.168.206.51@tcp:501:ll_cfg_requeue.0 Request processed in 629us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925297.278212:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 165 00000100:00100000:0.0:1788925297.280470:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925297.281300:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347648 00000100:00100000:1.0:1788925297.281310:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347648 00000100:00100000:1.0:1788925297.281650:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:1.0:1788925297.281661:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+13:18082:x1875823462347648:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788925297.281849:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608406050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:518e9438-b998-428e-81a8-4598516dcc95+13:18082:x1875823462347648:12345-192.168.206.51@tcp:503:ll_cfg_requeue.0 Request processed in 189us (1386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925297.281857:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 166 00000100:00100000:3.0:1788925297.322798:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925297.322824:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470859648:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788925297.322893:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925297.323158:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470859648 00000100:00100000:2.0:1788925297.323167:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470859648 00000100:00100000:2.0:1788925297.323235:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788925297.323245:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470859648:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925297.323273:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925297.323326:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875823470859648:12345-0@lo:13:osp-pre-0-1.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.323333:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788925297.323447:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3624:1875823470859648:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788925297.323603:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925297.554507:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.555069:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347776 00000100:00100000:3.0:1788925297.555082:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347776 00000100:00100000:3.0:1788925297.555166:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1788925297.555177:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5039b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:18706:x1875823462347776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788925297.555198:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925297.555220:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf7424069 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f374e expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555288:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555304:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555318:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555352:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555360:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555367:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555508:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf742407e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555517:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf742407e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555524:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf742407e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925297.555555:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788925297.555559:0:22633:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788925297.555598:0:22633:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf742407e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555609:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555615:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555621:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555637:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d984e00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:3.0:1788925297.555641:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555649:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555660:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:3.0:1788925297.555663:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925297.555676:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555683:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf7424070 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555697:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555703:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555709:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555714:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:3.0:1788925297.555716:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555722:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555739:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff97a502623500) 00010000:00010000:3.0:1788925297.555741:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788925297.555744:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.555751:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424077 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788925297.555916:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925297.556099:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf7424069 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f374e expref: 8 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.556113:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984a00/0x45e32cfaf742407e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f374e expref: 7 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.556121:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a502623e00) 00010000:00010000:3.0:1788925297.556123:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788925297.556126:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a62d984a00, rc 0) 00000100:00100000:3.0:1788925297.556235:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5039b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+7:18706:x1875823462347776:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 1060us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925297.556243:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1788925297.575127:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.575225:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462347904 00000100:00100000:2.0:1788925297.575234:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462347904 00000100:00100000:2.0:1788925297.575286:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:2.0:1788925297.575295:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18706:x1875823462347904:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788925297.575387:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18706:x1875823462347904:12345-192.168.206.51@tcp:900:lhsmtool_posix.0 Request processed in 84us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.575438:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1788925297.585448:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.585688:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348160 00000100:00100000:2.0:1788925297.585698:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348160 00000100:00100000:2.0:1788925297.585757:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:2.0:1788925297.585767:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:18706:x1875823462348160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788925297.585786:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.585807:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf7424085 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3755 expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585876:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585890:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585901:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585915:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585922:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.585928:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586039:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ca00/0x45e32cfaf742409a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586069:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ca00/0x45e32cfaf742409a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586076:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ca00/0x45e32cfaf742409a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.586086:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:2.0:1788925297.586250:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586258:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586264:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586269:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ce00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.586273:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586281:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586294:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff97a502623e00) 00010000:00010000:2.0:1788925297.586297:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.586301:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586307:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf742408c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586322:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586335:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586341:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586346:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858cc00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.586349:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586355:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586363:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.586365:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.586368:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.586373:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf7424093 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.591024:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf7424085 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3755 expref: 10 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.591051:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ca00/0x45e32cfaf742409a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3755 expref: 9 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.591061:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a602c31a00) 00010000:00010000:2.0:1788925297.591064:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.591082:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858ca00, rc 0) 00000100:00100000:2.0:1788925297.591149:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e350a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+9:18706:x1875823462348160:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 5383us (5753us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788925297.591158:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:0.0:1788925297.601857:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.602726:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348288 00000100:00100000:2.0:1788925297.602739:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348288 00000100:00100000:2.0:1788925297.602814:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:2.0:1788925297.602826:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+9:18706:x1875823462348288:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788925297.602935:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e353480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+9:18706:x1875823462348288:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 111us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.602943:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1788925297.608217:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.608316:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348416 00000100:00100000:0.0:1788925297.608326:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348416 00000100:00100000:0.0:1788925297.608439:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1788925297.608449:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:18706:x1875823462348416:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 00000100:00080000:1.0:1788925297.608606:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:1.0:1788925297.621509:0:22634:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 13016us 00000100:00100000:0.0:1788925297.648262:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.648299:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348544 00000100:00100000:0.0:1788925297.648308:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348544 00000100:00100000:0.0:1788925297.648358:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:0.0:1788925297.648368:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+9:18712:x1875823462348544:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1788925297.648396:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925297.648438:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf74240a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f375c expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648502:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648516:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648528:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648582:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648591:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648599:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648658:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648666:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648684:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648690:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925297.648694:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648702:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648714:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:0.0:1788925297.648717:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925297.648721:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648727:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648737:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648743:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648749:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648773:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925297.648776:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648782:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648790:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a612bc4100) 00010000:00010000:0.0:1788925297.648793:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925297.648796:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648802:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74240b6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648833:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf74240a8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f375c expref: 10 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648843:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:0.0:1788925297.648845:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925297.648849:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf74240a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f375c expref: 10 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.648857:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde0800, rc 0) 00000100:00100000:0.0:1788925297.648911:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+9:18712:x1875823462348544:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 544us (657us total) trans 0 rc 301/301 00000100:00100000:0.0:1788925297.648918:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1788925297.653195:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925297.657009:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:18706:x1875823462348416:12345-192.168.206.51@tcp:59:lhsmtool_posix.0 Request processed in 48551us (48792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925297.657029:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1788925297.657451:0:22641:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348672 00000100:00100000:0.0:1788925297.657464:0:22641:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348672 00000100:00100000:0.0:1788925297.657501:0:22641:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1788925297.657510:0:22641:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6568d3b8-2ff7-4199-8339-dd9864737580+9:18712:x1875823462348672:12345-192.168.206.51@tcp:700:lfs.0 00000100:00100000:0.0:1788925297.657557:0:22641:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6568d3b8-2ff7-4199-8339-dd9864737580+9:18712:x1875823462348672:12345-192.168.206.51@tcp:700:lfs.0 Request processed in 49us (4372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925297.657563:0:22641:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1788925297.663547:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.663585:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462348928 00000100:00100000:0.0:1788925297.663595:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462348928 00000100:00100000:0.0:1788925297.663647:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1788925297.663657:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a502831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+9:18712:x1875823462348928:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:0.0:1788925297.663718:0:23891:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925297.663744:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a60166d200/0x45e32cfaf7423fd6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f36c9 expref: 9 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.663772:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:0.0:1788925297.663778:0:23891:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788925297.663841:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.663856:0:23891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 5 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.663864:0:23891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.663897:0:23891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 5 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.663930:0:23891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 5 pid: 23891 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925297.663944:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470859776:192.168.206.51@tcp:104: 00000100:00100000:0.0:1788925297.664030:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a5035d3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925297.667824:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.667860:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349056 00000100:00100000:0.0:1788925297.667869:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349056 00010000:00010000:0.0:1788925297.667917:0:22619:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 6 pid: 23891 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925297.667950:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1788925297.667960:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2387:x1875823462349056:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925297.667973:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925297.667980:0:22619:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 6 pid: 23891 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.667992:0:22619:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 6 pid: 23891 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.668012:0:22619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:0.0:1788925297.668017:0:22619:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.668026:0:22619:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.668049:0:22619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.668067:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925297.668111:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2387:x1875823462349056:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 152us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925297.668118:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00080000:0.0:1788925297.668139:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788925297.668552:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf7424015 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3739 expref: 5 pid: 23891 timeout: 783 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925297.668570:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416e680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470859776:192.168.206.51@tcp:104: 00010000:00010000:3.0:1788925297.668596:0:23891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.668605:0:23891:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.668611:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.668631:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.668640:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.668649:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.671985:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672007:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672020:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925297.672038:0:23891:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c29c5914 reply state 00000000dadc873e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672050:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672058:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:0.0:1788925297.672061:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788925297.672065:0:23891:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788925297.672070:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788925297.672079:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672085:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672098:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672104:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925297.672109:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672117:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672277:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31200) 00010000:00010000:0.0:1788925297.672280:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925297.672284:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672291:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74240bd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788925297.672306:0:23891:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c29c5914 reply state 00000000dadc873e transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672315:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.672322:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a502623500) 00010000:00010000:0.0:1788925297.672324:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788925297.672326:0:23891:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788925297.672645:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a502831c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+10:18712:x1875823462348928:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 8984us (9102us total) trans 12884901890 rc 0/0 00000100:00100000:0.0:1788925297.672654:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1788925297.753100:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.753195:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349184 00000100:00100000:2.0:1788925297.753204:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349184 00000100:00100000:2.0:1788925297.753256:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:2.0:1788925297.753265:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+10:18720:x1875823462349184:12345-192.168.206.51@tcp:101:lctl.0 00010000:00010000:2.0:1788925297.753286:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.753306:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf74240d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3763 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753364:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf74240d9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753386:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf74240d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753398:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf74240d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.753472:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788925297.753486:0:22632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925297.753525:0:22632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf74240d9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753549:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf74240d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3763 expref: 12 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753567:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858cc00/0x45e32cfaf74240d9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3763 expref: 11 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.753574:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.753577:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925297.753580:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61858cc00, rc 0) 00000100:00100000:2.0:1788925297.753627:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+11:18720:x1875823462349184:12345-192.168.206.51@tcp:101:lctl.0 Request processed in 363us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.753634:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:1.0:1788925297.775813:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.775900:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349312 00000100:00100000:0.0:1788925297.775909:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349312 00000100:00100000:0.0:1788925297.775969:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1788925297.775980:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:18721:x1875823462349312:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:0.0:1788925297.775999:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925297.776018:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74240e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f376a expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776076:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1c00/0x45e32cfaf74240e7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776088:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1c00/0x45e32cfaf74240e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776099:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1c00/0x45e32cfaf74240e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925297.776137:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788925297.776141:0:22633:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788925297.776169:0:22633:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1c00/0x45e32cfaf74240e7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776190:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74240e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f376a expref: 7 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776207:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1c00/0x45e32cfaf74240e7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f376a expref: 6 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925297.776216:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:0.0:1788925297.776230:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788925297.776233:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde1c00, rc 0) 00000100:00100000:0.0:1788925297.776289:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18721:x1875823462349312:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 311us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925297.776296:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1788925297.781509:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.781598:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349440 00000100:00100000:2.0:1788925297.781606:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349440 00000100:00100000:2.0:1788925297.781656:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:2.0:1788925297.781665:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:18721:x1875823462349440:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1788925297.781693:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.781711:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf74240ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3771 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781774:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781799:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781827:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781850:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781858:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781865:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781935:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781944:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.781951:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.781985:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788925297.781989:0:22632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925297.782007:0:22632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782017:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782024:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782040:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782046:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61858ce00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.782050:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782057:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782068:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.782071:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.782076:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782083:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858ce00/0x45e32cfaf74240f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782095:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782100:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782107:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782111:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.782113:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782126:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782133:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a502623500) 00010000:00010000:2.0:1788925297.782135:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.782138:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782144:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74240fc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782166:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61858c400/0x45e32cfaf74240ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3771 expref: 8 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782178:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3771 expref: 7 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.782185:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925297.782187:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925297.782189:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09c00, rc 0) 00000100:00100000:2.0:1788925297.782249:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+7:18721:x1875823462349440:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 585us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.782257:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1788925297.784775:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.784887:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349568 00000100:00100000:2.0:1788925297.784896:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349568 00000100:00100000:2.0:1788925297.784956:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1788925297.784965:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:18721:x1875823462349568:12345-192.168.206.51@tcp:900:lfs.0 00000100:00100000:2.0:1788925297.785063:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:18721:x1875823462349568:12345-192.168.206.51@tcp:900:lfs.0 Request processed in 98us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.785070:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00080000:0.0:1788925297.785127:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788925297.789069:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.789164:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462349824 00000100:00100000:2.0:1788925297.789172:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462349824 00000100:00100000:2.0:1788925297.789221:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:2.0:1788925297.789230:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+7:18721:x1875823462349824:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1788925297.789246:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.789265:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742410a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3778 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.789352:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788925297.789473:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742410a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3778 expref: 9 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.789486:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.789489:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925297.789494:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742410a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3778 expref: 9 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.789508:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09a00, rc 0) 00000100:00100000:2.0:1788925297.789560:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+8:18721:x1875823462349824:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 331us (499us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788925297.789567:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1788925297.793522:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.793608:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462350080 00000100:00100000:2.0:1788925297.793616:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462350080 00000100:00100000:2.0:1788925297.793677:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:2.0:1788925297.793704:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+8:18721:x1875823462350080:12345-192.168.206.51@tcp:36:lfs.0 00010000:00010000:2.0:1788925297.793770:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925297.793808:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424103 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3771 expref: 8 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.793829:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925297.793834:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925297.793854:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.793866:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.793874:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925297.794045:0:22632:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b14f71db reply state 000000008577f775 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.794058:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.794063:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925297.794066:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788925297.794069:0:22632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788925297.794075:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788925297.794151:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+9:18721:x1875823462350080:12345-192.168.206.51@tcp:36:lfs.0 Request processed in 444us (628us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1788925297.794158:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1788925297.797490:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.797607:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462350336 00000100:00100000:3.0:1788925297.797615:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462350336 00000100:00100000:3.0:1788925297.797705:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:3.0:1788925297.797715:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+9:18721:x1875823462350336:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:3.0:1788925297.797954:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+10:18721:x1875823462350336:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 240us (471us total) trans 12884901893 rc 0/0 00000100:00100000:3.0:1788925297.797961:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1788925297.801481:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.801554:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462350592 00000100:00100000:2.0:1788925297.801574:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462350592 00000100:00100000:2.0:1788925297.801625:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:2.0:1788925297.801635:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+10:18721:x1875823462350592:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:2.0:1788925297.801658:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.801689:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf742411f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f377f expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801752:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801776:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801788:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801799:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801806:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801813:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.801902:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788925297.801970:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801979:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.801996:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802002:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.802006:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802014:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802025:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.802028:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.802032:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802038:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424126 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802051:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802057:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802063:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802067:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.802069:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802084:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802092:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a502623500) 00010000:00010000:2.0:1788925297.802094:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.802098:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802103:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf742412d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802131:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf742411f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f377f expref: 12 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802141:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.802259:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925297.802264:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf742411f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f377f expref: 12 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.802275:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09c00, rc 0) 00000100:00100000:2.0:1788925297.802388:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+11:18721:x1875823462350592:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 754us (914us total) trans 12884901894 rc 301/301 00000100:00100000:2.0:1788925297.802395:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1788925297.806132:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925297.806230:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462350720 00000100:00100000:1.0:1788925297.806239:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462350720 00000100:00100000:1.0:1788925297.806344:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:1.0:1788925297.806354:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+11:18721:x1875823462350720:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1788925297.806383:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925297.806427:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23c00/0x45e32cfaf742413b lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3786 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806519:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806531:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806542:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925297.806566:0:22634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788925297.806569:0:22634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788925297.806588:0:22634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806610:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23c00/0x45e32cfaf742413b lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 13 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806638:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925297.806647:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:1.0:1788925297.806649:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788925297.806652:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22c00, rc 0) 00000100:00100000:1.0:1788925297.806714:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+12:18721:x1875823462350720:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 362us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925297.806721:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 35 00000100:00100000:3.0:1788925297.810318:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.810542:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462350848 00000100:00100000:0.0:1788925297.810551:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462350848 00000100:00100000:0.0:1788925297.810593:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:0.0:1788925297.810604:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+12:18721:x1875823462350848:12345-192.168.206.51@tcp:37:lfs.0 00000100:00100000:2.0:1788925297.815564:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+12:18721:x1875823462350848:12345-192.168.206.51@tcp:37:lfs.0 Request processed in 4951us (5243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.815580:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1788925297.820993:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.821071:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351104 00000100:00100000:0.0:1788925297.821079:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351104 00000100:00100000:0.0:1788925297.821129:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 4 00000100:00100000:0.0:1788925297.821137:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+12:18721:x1875823462351104:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1788925297.821343:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f1d450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+13:18721:x1875823462351104:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 206us (359us total) trans 12884901895 rc 0/0 00000100:00100000:0.0:1788925297.821351:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 4 00010000:00010000:0.0:1788925297.898554:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925297.925798:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.925919:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351232 00000100:00100000:2.0:1788925297.925941:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351232 00000100:00100000:2.0:1788925297.925996:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:2.0:1788925297.926005:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+11:18728:x1875823462351232:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1788925297.926023:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.926052:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424149 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f378d expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926110:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926125:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926137:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926160:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926169:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926176:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926249:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08c00/0x45e32cfaf742415e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926258:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08c00/0x45e32cfaf742415e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926265:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08c00/0x45e32cfaf742415e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.926303:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788925297.926307:0:22633:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925297.926345:0:22633:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08c00/0x45e32cfaf742415e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926357:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926364:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926370:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926386:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.926391:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926435:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.926450:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:2.0:1788925297.927862:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.927875:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927884:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424150 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927903:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927926:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927932:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927937:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.927941:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927948:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927961:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a502623500) 00010000:00010000:2.0:1788925297.927964:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.927967:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.927973:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf7424157 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.928008:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424149 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f378d expref: 13 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.928022:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08c00/0x45e32cfaf742415e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f378d expref: 12 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.928030:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925297.928032:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788925297.928041:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd08c00, rc 0) 00000100:00100000:2.0:1788925297.928179:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+12:18728:x1875823462351232:12345-192.168.206.51@tcp:101:bash.0 Request processed in 2174us (2389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.928188:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 36 00000100:00100000:1.0:1788925297.944166:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.944264:0:22643:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351360 00000100:00100000:2.0:1788925297.944275:0:22643:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351360 00000100:00100000:2.0:1788925297.944338:0:22643:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1788925297.944348:0:22643:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6568d3b8-2ff7-4199-8339-dd9864737580+5:18728:x1875823462351360:12345-192.168.206.51@tcp:900:bash.0 00000100:00100000:2.0:1788925297.944477:0:22643:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6568d3b8-2ff7-4199-8339-dd9864737580+5:18728:x1875823462351360:12345-192.168.206.51@tcp:900:bash.0 Request processed in 130us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925297.944485:0:22643:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:0.0:1788925297.949279:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925297.949387:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351616 00000100:00100000:2.0:1788925297.949397:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351616 00000100:00100000:2.0:1788925297.949498:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:2.0:1788925297.949508:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+12:18728:x1875823462351616:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1788925297.949528:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925297.949546:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424165 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3794 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.949651:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.949685:0:22632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.949695:0:22632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.949744:0:22632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 12 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.949769:0:22632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 12 pid: 22634 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925297.949783:0:22632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22632:1875823470859904:192.168.206.51@tcp:104: 00000100:00100000:2.0:1788925297.949856:0:22632:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a63581a780 going to sleep for 11 seconds 00000100:00100000:0.0:1788925297.960133:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.960858:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351744 00000100:00100000:3.0:1788925297.960869:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351744 00010000:00010000:3.0:1788925297.960919:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 13 pid: 22634 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925297.960962:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 16 00000100:00100000:3.0:1788925297.960972:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+13:2387:x1875823462351744:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788925297.960985:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788925297.960993:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 13 pid: 22634 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.961006:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 13 pid: 22634 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.961027:0:22618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:3.0:1788925297.961032:0:22618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.961042:0:22618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.961050:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.961068:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788925297.961176:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+13:2387:x1875823462351744:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 205us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925297.961184:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 16 00010000:00010000:2.0:1788925297.961891:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424142 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3786 expref: 12 pid: 22634 timeout: 784 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925297.961914:0:22632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22632:1875823470859904:192.168.206.51@tcp:104: 00010000:00010000:2.0:1788925297.961935:0:22632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.961944:0:22632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.961950:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.961971:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.961981:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.961989:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962574:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962584:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962592:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925297.962602:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788925297.962628:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962635:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962642:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962647:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925297.962652:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962660:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962680:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925297.962683:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925297.962688:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962705:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf742416c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925297.962718:0:22632:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fe827773 reply state 00000000ae674838 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962730:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962736:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff97a602c31500) 00010000:00010000:2.0:1788925297.962739:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788925297.962741:0:22632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788925297.962785:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424165 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 15 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962800:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 14 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925297.962807:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925297.962809:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788925297.962811:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd08400, rc 0) 00000100:00100000:2.0:1788925297.962853:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+15:18728:x1875823462351616:12345-192.168.206.51@tcp:101:bash.0 Request processed in 13348us (13583us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788925297.962861:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 37 00000100:00100000:0.0:1788925297.989641:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925297.989738:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462351872 00000100:00100000:3.0:1788925297.989749:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462351872 00000100:00100000:3.0:1788925297.989872:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:3.0:1788925297.989895:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+15:18728:x1875823462351872:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:3.0:1788925297.989919:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925297.989938:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424188 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f379b expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990001:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990015:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990026:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925297.990073:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788925297.990077:0:23891:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788925297.990102:0:23891:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990113:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990137:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf7424188 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f379b expref: 17 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990154:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f379b expref: 16 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925297.990162:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:3.0:1788925297.990165:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788925297.990176:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a62d984e00, rc 0) 00000100:00100000:3.0:1788925297.990235:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+16:18728:x1875823462351872:12345-192.168.206.51@tcp:101:bash.0 Request processed in 343us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925297.990242:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 38 00000100:00100000:1.0:1788925297.997202:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925297.997291:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462352128 00000100:00100000:0.0:1788925297.997300:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462352128 00000100:00100000:0.0:1788925297.997369:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1788925297.997379:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+16:18728:x1875823462352128:12345-192.168.206.51@tcp:35:bash.0 00000100:00100000:0.0:1788925298.000763:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+17:18728:x1875823462352128:12345-192.168.206.51@tcp:35:bash.0 Request processed in 3363us (3544us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788925298.000778:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 5 00000100:00100000:0.0:1788925298.169727:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925298.169886:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462352384 00000100:00100000:1.0:1788925298.169896:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462352384 00000100:00100000:1.0:1788925298.169955:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1788925298.169966:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+17:18738:x1875823462352384:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1788925298.169989:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925298.170008:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23000/0x45e32cfaf7424196 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37a2 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925298.170099:0:22634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788925298.170190:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23000/0x45e32cfaf7424196 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37a2 expref: 19 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925298.170205:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:1.0:1788925298.170207:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788925298.170223:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23000/0x45e32cfaf7424196 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37a2 expref: 19 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925298.170236:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23000, rc 0) 00000100:00100000:1.0:1788925298.170290:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+18:18738:x1875823462352384:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 326us (573us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788925298.170297:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 39 00000100:00100000:1.0:1788925298.174172:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925298.174258:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462352640 00000100:00100000:2.0:1788925298.174268:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462352640 00000100:00100000:2.0:1788925298.174322:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:2.0:1788925298.174332:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+18:18738:x1875823462352640:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1788925298.174582:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+19:18738:x1875823462352640:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 252us (419us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788925298.174589:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 6 00000100:00100000:0.0:1788925298.298447:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925298.298574:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462352896 00000100:00100000:3.0:1788925298.298583:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462352896 00000100:00100000:3.0:1788925298.298648:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1788925298.298659:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+19:18741:x1875823462352896:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:3.0:1788925298.298698:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788925298.298721:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf74241a4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37a9 expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925298.299081:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74241ab lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925298.299099:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74241ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925298.299111:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74241ab lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788925298.299123:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788925298.299220:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf74241a4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37a9 expref: 22 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925298.299239:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74241ab lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37a9 expref: 21 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925298.299247:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:3.0:1788925298.299262:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788925298.299266:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a62d985600, rc 0) 00000100:00100000:3.0:1788925298.299375:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+21:18741:x1875823462352896:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 718us (979us total) trans 12884901900 rc 0/0 00000100:00100000:3.0:1788925298.299382:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 40 00000100:00100000:3.0:1788925298.312612:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925298.312853:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353024 00000100:00100000:0.0:1788925298.312862:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353024 00000100:00100000:0.0:1788925298.312921:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:0.0:1788925298.312931:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+21:2387:x1875823462353024:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925298.312944:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925298.312967:0:22620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985600/0x45e32cfaf74241ab lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37a9 expref: 21 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925298.312985:0:22620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925298.312989:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925298.313045:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+20:2387:x1875823462353024:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 116us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925298.313060:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:1.0:1788925298.320295:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925298.320393:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353152 00000100:00100000:2.0:1788925298.320424:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353152 00000100:00100000:2.0:1788925298.320481:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:2.0:1788925298.320491:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+20:18741:x1875823462353152:12345-192.168.206.51@tcp:54:lfs.0 00010000:00010000:2.0:1788925298.320682:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320698:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320709:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320742:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320749:0:22634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320825:0:22634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320832:0:22634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09c00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925298.320836:0:22634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320844:0:22634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320870:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925298.320872:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925298.320877:0:22634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.320885:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241b9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925298.321002:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+20:18741:x1875823462353152:12345-192.168.206.51@tcp:54:lfs.0 Request processed in 513us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925298.321009:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 41 00000100:00100000:1.0:1788925298.331211:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925298.333165:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353408 00000100:00100000:2.0:1788925298.333179:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353408 00000100:00100000:2.0:1788925298.333302:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1788925298.333312:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+20:18741:x1875823462353408:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:2.0:1788925298.333529:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+21:18741:x1875823462353408:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 218us (2326us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788925298.333535:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 7 00000100:00100000:2.0:1788925298.346805:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62ef90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788925298.346876:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925298.347022:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470860160 00000100:00100000:3.0:1788925298.347030:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470860160 00000100:00100000:3.0:1788925298.347086:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788925298.347094:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470860160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788925298.347125:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788925298.347174:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470860160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 81us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.347180:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788925298.347221:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62ef90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470860160:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925298.347563:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470860032:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925298.347598:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788925298.348293:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788925298.348535:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470860032 00000100:00100000:3.0:1788925298.348549:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470860032 00000100:00100000:3.0:1788925298.348595:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788925298.348602:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470860032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925298.348620:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788925298.348674:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470860032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.348681:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788925298.349034:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470860032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788925298.349182:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925298.405772:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925298.405815:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925298.405847:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925298.405878:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925298.405892:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353792 00000100:00100000:0.0:1788925298.405902:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353792 00000100:00100000:3.0:1788925298.405922:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925298.405940:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462354048 00000100:00100000:3.0:1788925298.405943:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462354048 00000100:00100000:0.0:1788925298.405946:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353664 00000100:00100000:0.0:1788925298.405954:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353664 00000100:00100000:3.0:1788925298.405959:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353920 00000100:00100000:3.0:1788925298.405962:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353920 00000100:00100000:0.0:1788925298.405973:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:0.0:1788925298.405981:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462353792:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925298.406018:0:22626:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462353536 00000100:00100000:2.0:1788925298.406022:0:22626:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462353536 00000100:00100000:0.0:1788925298.406043:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462353792:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925298.406047:0:22626:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:2.0:1788925298.406116:0:22626:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:2389:x1875823462353536:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925298.406146:0:22626:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608407050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:518e9438-b998-428e-81a8-4598516dcc95+13:2389:x1875823462353536:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925298.406153:0:22626:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 167 00000100:00100000:3.0:1788925298.409080:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1788925298.409104:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462354048:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1788925298.409168:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462354048:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 76us (3320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.409176:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:3.0:1788925298.409198:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1788925298.409205:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462353664:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1788925298.409234:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462353664:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 29us (3355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.409239:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 24 00000100:00100000:3.0:1788925298.409251:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00100000:3.0:1788925298.409257:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462353920:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:3.0:1788925298.409276:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462353920:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 20us (3354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925298.409281:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 25 00000100:00080000:3.0:1788925298.409301:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788925298.409305:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925298.412293:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00000040:00080000:2.0:1788925298.478226:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788925298.859379:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788925298.859418:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470860288:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788925298.859482:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925298.859573:0:22638:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470860288 00000100:00100000:1.0:1788925298.859582:0:22638:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470860288 00000100:00100000:1.0:1788925298.859631:0:22638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788925298.859640:0:22638:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470860288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788925298.859680:0:22638:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788925298.859732:0:22638:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1875823470860288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925298.859738:0:22638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788925298.859882:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63c71ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3621:1875823470860288:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925298.875733:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925298.875828:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462354304 00000100:00100000:2.0:1788925298.875838:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462354304 00000100:00100000:2.0:1788925298.875967:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:2.0:1788925298.875976:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+21:18772:x1875823462354304:12345-192.168.206.51@tcp:101:cat.0 00010000:00010000:2.0:1788925298.875999:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925298.876018:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241c0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37b0 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.876113:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74241c7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.876125:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74241c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.876289:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74241c7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925298.876301:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788925298.876438:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74241c0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b0 expref: 24 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.876457:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74241c7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b0 expref: 23 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925298.876484:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925298.876487:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925298.876491:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09a00, rc 0) 00000100:00100000:2.0:1788925298.876546:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+23:18772:x1875823462354304:12345-192.168.206.51@tcp:101:cat.0 Request processed in 571us (821us total) trans 12884901902 rc 0/0 00000100:00100000:2.0:1788925298.876553:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 42 00000100:00100000:3.0:1788925298.886110:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925298.886253:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462354560 00000100:00100000:0.0:1788925298.886262:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462354560 00000100:00100000:0.0:1788925298.886313:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:0.0:1788925298.886321:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+23:18772:x1875823462354560:12345-192.168.206.51@tcp:35:cat.0 00000100:00100000:0.0:1788925298.886602:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+24:18772:x1875823462354560:12345-192.168.206.51@tcp:35:cat.0 Request processed in 280us (499us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788925298.886610:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 8 00000100:00100000:3.0:1788925298.893339:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925298.893531:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462354688 00000100:00100000:0.0:1788925298.893541:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462354688 00000100:00100000:0.0:1788925298.893612:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 1 00000100:00100000:0.0:1788925298.893622:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6568d3b8-2ff7-4199-8339-dd9864737580+24:2388:x1875823462354688:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925298.893637:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925298.893668:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09a00/0x45e32cfaf74241c7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b0 expref: 24 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925298.893687:0:22619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925298.893692:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925298.893740:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6568d3b8-2ff7-4199-8339-dd9864737580+23:2388:x1875823462354688:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 121us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925298.893747:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 1 00010000:00010000:3.0:1788925298.922624:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788925299.005269:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925299.005615:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462354944 00000100:00100000:0.0:1788925299.005624:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462354944 00000100:00100000:0.0:1788925299.005701:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:0.0:1788925299.005711:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+23:18778:x1875823462354944:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1788925299.005733:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925299.005760:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1a00/0x45e32cfaf74241d5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37b7 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.006257:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74241dc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.006272:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74241dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.006282:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74241dc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925299.006292:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000100:00080000:3.0:1788925299.006651:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788925299.011719:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1a00/0x45e32cfaf74241d5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b7 expref: 26 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.011744:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74241dc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b7 expref: 25 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.011820:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925299.011822:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788925299.011838:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde0c00, rc 0) 00000100:00100000:1.0:1788925299.012023:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+25:18778:x1875823462354944:12345-192.168.206.51@tcp:101:dd.0 Request processed in 6312us (6761us total) trans 12884901904 rc 0/0 00000100:00100000:1.0:1788925299.012031:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 43 00000100:00100000:3.0:1788925299.020304:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925299.020343:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925299.020427:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462355200 00000100:00100000:2.0:1788925299.020436:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462355200 00000100:00100000:2.0:1788925299.020494:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:2.0:1788925299.020504:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+25:2390:x1875823462355200:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925299.020519:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925299.020553:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0c00/0x45e32cfaf74241dc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37b7 expref: 25 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925299.020571:0:22618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925299.020576:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925299.020669:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462355072 00000100:00100000:0.0:1788925299.020674:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462355072 00000100:00100000:0.0:1788925299.020703:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:0.0:1788925299.020709:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+25:18778:x1875823462355072:12345-192.168.206.51@tcp:101:dd.0 00010000:00010000:0.0:1788925299.020725:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925299.020737:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74241ea lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37be expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020773:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020785:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020811:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020914:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74241ea lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 27 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020927:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 26 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.020934:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925299.020937:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788925299.020940:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde0a00, rc 0) 00000100:00100000:2.0:1788925299.028244:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+26:2390:x1875823462355200:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 7728us (7887us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925299.028260:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 2 00000100:00100000:0.0:1788925299.032010:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+25:18778:x1875823462355072:12345-192.168.206.51@tcp:101:dd.0 Request processed in 11285us (11698us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925299.032025:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 44 00000100:00100000:2.0:1788925299.047050:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925299.047709:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462355456 00000100:00100000:1.0:1788925299.047721:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462355456 00000100:00100000:1.0:1788925299.048647:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 45 00000100:00100000:1.0:1788925299.048671:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63c71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+25:18778:x1875823462355456:12345-192.168.206.51@tcp:36:dd.0 00010000:00010000:1.0:1788925299.048720:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925299.048744:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d984e00/0x45e32cfaf742418f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f379b expref: 25 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.048833:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925299.048838:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925299.049055:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.049070:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.049081:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788925299.049122:0:22634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:1.0:1788925299.049162:0:22634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000bab75a4 reply state 00000000c25aca23 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.049174:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.049197:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925299.049200:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788925299.049203:0:22634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925299.049351:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63c71ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+27:18778:x1875823462355456:12345-192.168.206.51@tcp:36:dd.0 Request processed in 693us (2309us total) trans 12884901906 rc 0/0 00000100:00100000:1.0:1788925299.049359:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 45 00000020:00080000:1.0:1788925299.049364:0:22634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788925299.232908:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925299.233004:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462355712 00000100:00100000:0.0:1788925299.233013:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462355712 00000100:00100000:0.0:1788925299.233071:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 9 00000100:00100000:0.0:1788925299.233082:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+27:18778:x1875823462355712:12345-192.168.206.51@tcp:35:dd.0 00000100:00100000:0.0:1788925299.233304:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+28:18778:x1875823462355712:12345-192.168.206.51@tcp:35:dd.0 Request processed in 223us (405us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788925299.233311:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 9 00000040:00080000:0.0:1788925299.500253:0:23383:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788925299.548090:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925299.548488:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462355840 00000100:00100000:0.0:1788925299.548498:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462355840 00000100:00100000:0.0:1788925299.548562:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:0.0:1788925299.548583:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+28:18792:x1875823462355840:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:0.0:1788925299.548603:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925299.548621:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74241ff lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37c5 expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548688:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548702:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548713:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548722:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548730:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548735:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548795:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548803:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548811:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925299.548867:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788925299.548871:0:23891:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788925299.548906:0:23891:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548917:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548925:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548931:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548938:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548944:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0800 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925299.548949:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548955:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548965:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:0.0:1788925299.548969:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925299.548972:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.548978:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424206 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549000:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549006:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549011:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549015:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde1400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925299.549017:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549024:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549031:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff97a602c31500) 00010000:00010000:0.0:1788925299.549033:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925299.549036:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549041:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742420d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549063:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0400/0x45e32cfaf74241ff lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37c5 expref: 30 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549075:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37c5 expref: 29 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.549091:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925299.549094:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925299.549096:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde1000, rc 0) 00000100:00100000:0.0:1788925299.549152:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+29:18792:x1875823462355840:12345-192.168.206.51@tcp:101:stat.0 Request processed in 571us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925299.549158:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 46 00000100:00100000:3.0:1788925299.716544:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925299.716645:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462356096 00000100:00100000:1.0:1788925299.716655:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462356096 00000100:00100000:1.0:1788925299.716720:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 47 00000100:00100000:1.0:1788925299.716729:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+29:18798:x1875823462356096:12345-192.168.206.51@tcp:36:truncate.0 00010000:00010000:1.0:1788925299.716783:0:22634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925299.716816:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424214 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37c5 expref: 29 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.716844:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925299.716850:0:22634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788925299.716988:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.717002:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.717011:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788925299.717061:0:22634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:1.0:1788925299.717080:0:22634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000599078f2 reply state 000000008f190d13 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.717092:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925299.717098:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925299.717101:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788925299.717103:0:22634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925299.717223:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+31:18798:x1875823462356096:12345-192.168.206.51@tcp:36:truncate.0 Request processed in 494us (686us total) trans 12884901909 rc 0/0 00000100:00100000:1.0:1788925299.717230:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 47 00000020:00080000:1.0:1788925299.717234:0:22634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788925299.946653:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788925299.966291:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925299.966427:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462356224 00000100:00100000:0.0:1788925299.966437:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462356224 00000100:00100000:0.0:1788925299.966494:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1788925299.966504:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+31:18812:x1875823462356224:12345-192.168.206.51@tcp:101:stat.0 00010000:00010000:0.0:1788925299.966526:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925299.966545:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf7424222 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37cc expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966608:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966622:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966633:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966644:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966652:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966687:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966754:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966763:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966770:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925299.966806:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:0.0:1788925299.966810:0:23891:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788925299.966828:0:23891:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966839:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966848:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966854:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966861:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966867:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0800 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925299.966871:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966885:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966897:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:0.0:1788925299.966900:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925299.966905:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966910:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0800/0x45e32cfaf7424229 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966921:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966927:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966932:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966937:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925299.966939:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966944:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966950:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff97a602c31500) 00010000:00010000:0.0:1788925299.966952:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925299.966954:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966970:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424230 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.966995:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf7424222 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 33 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.967008:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 32 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925299.967014:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925299.967016:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788925299.967019:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde1000, rc 0) 00000100:00100000:0.0:1788925299.967079:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+32:18812:x1875823462356224:12345-192.168.206.51@tcp:101:stat.0 Request processed in 576us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925299.967085:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 48 00000100:00100000:0.0:1788925300.132640:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.132746:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462356480 00000100:00100000:1.0:1788925300.132756:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462356480 00000100:00100000:1.0:1788925300.132817:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:1.0:1788925300.132827:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+32:18821:x1875823462356480:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1788925300.132855:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.132874:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf742423e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37d3 expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925300.132959:0:22634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788925300.133047:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf742423e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37d3 expref: 34 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.133061:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:1.0:1788925300.133076:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788925300.133082:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf742423e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37d3 expref: 34 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.133095:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22800, rc 0) 00000100:00100000:1.0:1788925300.133158:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62e35bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+33:18821:x1875823462356480:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 333us (526us total) trans 12884901910 rc 301/301 00000100:00100000:1.0:1788925300.133164:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 49 00000100:00100000:3.0:1788925300.135754:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925300.140966:0:22635:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462356736 00000100:00100000:0.0:1788925300.140981:0:22635:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462356736 00000100:00100000:0.0:1788925300.141095:0:22635:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:0.0:1788925300.141104:0:22635:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+33:18821:x1875823462356736:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:0.0:1788925300.141342:0:22635:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f1dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6568d3b8-2ff7-4199-8339-dd9864737580+34:18821:x1875823462356736:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 237us (5594us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1788925300.141350:0:22635:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 10 00000100:00100000:3.0:1788925300.256664:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925300.256786:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462356992 00000100:00100000:0.0:1788925300.256796:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462356992 00000100:00100000:0.0:1788925300.256858:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:0.0:1788925300.256883:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+34:18828:x1875823462356992:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:0.0:1788925300.256910:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788925300.256931:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742424c lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37da expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257033:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257049:0:23891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 35 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257057:0:23891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 35 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257065:0:23891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257099:0:23891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 35 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257113:0:23891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 35 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.257127:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470860416:192.168.206.51@tcp:104: 00010000:00010000:0.0:1788925300.257229:0:23891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 35 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.257240:0:23891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 35 pid: 22632 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.257256:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a60913df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470860544:192.168.206.51@tcp:104: 00000100:00100000:0.0:1788925300.257282:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a62ef98e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788925300.262801:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925300.262840:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.262992:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357120 00000100:00100000:2.0:1788925300.263001:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357120 00010000:00010000:2.0:1788925300.263039:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 36 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.263074:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357248 00000100:00100000:2.0:1788925300.263089:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357248 00010000:00010000:2.0:1788925300.263104:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 37 pid: 22632 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.263119:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1788925300.263127:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+37:2389:x1875823462357120:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925300.263153:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.263159:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 37 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263172:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 37 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263193:0:22620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.263198:0:22620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263208:0:22620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263214:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925300.263260:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef21850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+37:2389:x1875823462357120:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 134us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.263267:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 17 00000100:00100000:2.0:1788925300.263315:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 18 00000100:00100000:2.0:1788925300.263321:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+36:2389:x1875823462357248:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925300.263328:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.263333:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 36 pid: 22632 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263348:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 36 pid: 22632 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263359:0:22620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.263363:0:22620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263382:0:22620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263390:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.263435:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925300.263461:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+36:2389:x1875823462357248:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 135us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.263468:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 18 00010000:00010000:0.0:1788925300.266524:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1000/0x45e32cfaf7424237 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37cc expref: 35 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.266550:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470860416:192.168.206.51@tcp:104: 00010000:00010000:0.0:1788925300.266564:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08400/0x45e32cfaf742417a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3794 expref: 34 pid: 22632 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.266575:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a60913df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470860544:192.168.206.51@tcp:104: 00010000:00010000:0.0:1788925300.266597:0:23891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.266606:0:23891:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.266611:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788925300.267956:0:23891:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788925300.271895:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde1400/0x45e32cfaf742424c lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 35 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.271924:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 34 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.271934:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.271937:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788925300.271940:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fde0200, rc 0) 00000100:00100000:1.0:1788925300.272065:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+34:18828:x1875823462356992:12345-192.168.206.51@tcp:101:bash.0 Request processed in 15183us (15418us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788925300.272074:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 50 00000100:00100000:3.0:1788925300.281134:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.281210:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357504 00000100:00100000:1.0:1788925300.281219:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357504 00000100:00100000:1.0:1788925300.281280:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 51 00000100:00100000:1.0:1788925300.281290:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+34:18828:x1875823462357504:12345-192.168.206.51@tcp:36:bash.0 00010000:00010000:1.0:1788925300.281577:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.281595:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.281629:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788925300.281952:0:22634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:1.0:1788925300.281976:0:22634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005d4889bd reply state 000000007dc2a093 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.281989:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.281997:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.282000:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788925300.282003:0:22634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925300.282094:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+37:18828:x1875823462357504:12345-192.168.206.51@tcp:36:bash.0 Request processed in 804us (966us total) trans 12884901914 rc 0/0 00000100:00100000:1.0:1788925300.282101:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 51 00000020:00080000:1.0:1788925300.282106:0:22634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788925300.286666:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.287936:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357632 00000100:00100000:2.0:1788925300.287949:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357632 00000100:00100000:2.0:1788925300.288015:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:2.0:1788925300.288026:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+37:18828:x1875823462357632:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1788925300.288053:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.288074:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424268 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37e1 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.288127:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424268 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e1 expref: 38 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.288903:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424268 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e1 expref: 38 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.288929:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.288932:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788925300.288937:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09c00, rc 0) 00000100:00100000:2.0:1788925300.289056:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+38:18828:x1875823462357632:12345-192.168.206.51@tcp:101:bash.0 Request processed in 1031us (2406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.289065:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 52 00000100:00100000:3.0:1788925300.303004:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.303105:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357760 00000100:00100000:2.0:1788925300.303115:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357760 00000100:00100000:2.0:1788925300.303184:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:2.0:1788925300.303194:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+38:18828:x1875823462357760:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1788925300.303213:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.303232:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf742426f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37e8 expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.303315:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.303330:0:22632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 39 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.303339:0:22632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.303384:0:22632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 39 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.303441:0:22632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 39 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.303455:0:22632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22632:1875823470860672:192.168.206.51@tcp:104: 00000100:00100000:2.0:1788925300.303535:0:22632:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60acc53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925300.307513:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.308632:0:22632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22632:1875823470860672:192.168.206.51@tcp:104: 00010000:00010000:2.0:1788925300.308671:0:22632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.314385:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462357888 00000100:00100000:0.0:1788925300.314415:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462357888 00010000:00010000:0.0:1788925300.314463:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 40 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.314499:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 19 00000100:00100000:0.0:1788925300.314523:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+40:2388:x1875823462357888:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788925300.314536:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788925300.314544:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 40 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314557:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 40 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314577:0:22620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0200/0x45e32cfaf7424253 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37da expref: 40 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314592:0:22620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925300.314596:0:22620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314605:0:22620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314612:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.314660:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788925300.314713:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+39:2388:x1875823462357888:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 191us (7207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925300.314719:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 19 00010000:00010000:2.0:1788925300.314940:0:22632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.314948:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925300.314992:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788925300.314995:0:22632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925300.315012:0:22632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.315038:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf742426f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e8 expref: 39 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.315052:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e8 expref: 38 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.315060:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.315068:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788925300.315071:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09000, rc 0) 00000100:00100000:2.0:1788925300.315095:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+38:18828:x1875823462357760:12345-192.168.206.51@tcp:101:bash.0 Request processed in 11903us (12102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.315101:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 53 00000100:00100000:3.0:1788925300.318488:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.319899:0:22619:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358144 00000100:00100000:2.0:1788925300.319911:0:22619:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358144 00000100:00100000:2.0:1788925300.319973:0:22619:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:2.0:1788925300.319984:0:22619:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6568d3b8-2ff7-4199-8339-dd9864737580+38:18828:x1875823462358144:12345-192.168.206.51@tcp:103:bash.0 00010000:00010000:2.0:1788925300.319999:0:22619:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788925300.320022:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424268 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e1 expref: 38 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.320044:0:22619:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf7424276 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37e8 expref: 37 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.320054:0:22619:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.320059:0:22619:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925300.320121:0:22619:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6568d3b8-2ff7-4199-8339-dd9864737580+36:18828:x1875823462358144:12345-192.168.206.51@tcp:103:bash.0 Request processed in 139us (1642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.320565:0:22619:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 3 00000100:00100000:3.0:1788925300.322696:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.322797:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358272 00000100:00100000:1.0:1788925300.322806:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358272 00000100:00100000:1.0:1788925300.322856:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:1.0:1788925300.322865:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+36:18828:x1875823462358272:12345-192.168.206.51@tcp:58:bash.0 00010000:00010000:1.0:1788925300.322958:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.322976:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.322988:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925300.326842:0:23891:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788925300.326876:0:23891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788925300.326998:0:23891:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788925300.327098:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+36:18828:x1875823462358272:12345-192.168.206.51@tcp:58:bash.0 Request processed in 4230us (4405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.327109:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 54 00000100:00100000:3.0:1788925300.329584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.329763:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358400 00000100:00100000:1.0:1788925300.329773:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358400 00000100:00100000:1.0:1788925300.329828:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 55 00000100:00100000:1.0:1788925300.329838:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+36:18828:x1875823462358400:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1788925300.329856:0:22634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.329875:0:22634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37ef expref: -99 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.329944:0:22634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.329956:0:22634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 37 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.329973:0:22634:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.329986:0:22634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 37 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.329999:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.330007:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788925300.330012:0:22634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 37 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.330021:0:22634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23a00, rc 0) 00000100:00100000:1.0:1788925300.330306:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+37:18828:x1875823462358400:12345-192.168.206.51@tcp:101:bash.0 Request processed in 292us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.330315:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 55 00000040:00080000:2.0:1788925300.394600:0:22665:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788925300.394609:0:22665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788925300.394634:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788925300.394642:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:2.0:1788925300.394763:0:22665:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22665:1875823470860800:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788925300.394843:0:22665:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a60acc5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788925300.400616:0:22665:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416f480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22665:1875823470860800:192.168.206.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788925300.408192:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.408440:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358528 00000100:00100000:2.0:1788925300.408449:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358528 00000100:00100000:2.0:1788925300.408509:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:2.0:1788925300.408520:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+37:18829:x1875823462358528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788925300.408549:0:22633:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788925300.408661:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+37:18829:x1875823462358528:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 134us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.408669:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 56 00000100:00100000:3.0:1788925300.414884:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.415087:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358656 00000100:00100000:2.0:1788925300.415096:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358656 00000100:00100000:2.0:1788925300.415151:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:2.0:1788925300.415160:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+37:18829:x1875823462358656:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.415224:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415240:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415251:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415303:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415311:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415318:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415357:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415377:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415384:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925300.415475:0:22632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788925300.415480:0:22632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925300.415491:0:22632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415501:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415508:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415515:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415520:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.415524:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415531:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415541:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a602c31a00) 00010000:00010000:2.0:1788925300.415549:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925300.415554:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415560:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf742428b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415571:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415577:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415583:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415587:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09c00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.415590:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415596:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415602:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff97a602c31f00) 00010000:00010000:2.0:1788925300.415604:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925300.415606:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415612:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf7424292 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415623:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415634:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415639:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415644:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08e00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.415646:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415652:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415669:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.415671:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925300.415675:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.415681:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424299 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.415750:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+37:18829:x1875823462358656:12345-192.168.206.51@tcp:34:lhsmtool_posix.0 Request processed in 591us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.415758:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 57 00000100:00100000:3.0:1788925300.421599:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.421718:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462358912 00000100:00100000:2.0:1788925300.421728:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462358912 00000100:00100000:2.0:1788925300.421800:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:2.0:1788925300.421811:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+37:18829:x1875823462358912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.421830:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.421863:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242a0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37f6 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422185:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422202:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422214:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925300.422226:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788925300.422305:0:22633:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422314:0:22633:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422321:0:22633:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422327:0:22633:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.422331:0:22633:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422337:0:22633:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422348:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.422351:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788925300.422356:0:22633:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422372:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242a7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422441:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242a0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37f6 expref: 39 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422450:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff97a602c31a00) 00010000:00010000:2.0:1788925300.422453:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788925300.422456:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242a0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37f6 expref: 39 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.422465:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd08a00, rc 0) 00000100:00100000:2.0:1788925300.422529:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a503ba7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+38:18829:x1875823462358912:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 720us (940us total) trans 12884901915 rc 301/301 00000100:00100000:2.0:1788925300.422537:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 58 00000100:00100000:3.0:1788925300.429463:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.429597:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462359040 00000100:00100000:2.0:1788925300.429607:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462359040 00000100:00100000:2.0:1788925300.429681:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:2.0:1788925300.429692:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+38:18829:x1875823462359040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788925300.429725:0:22632:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788925300.429850:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+38:18829:x1875823462359040:12345-192.168.206.51@tcp:53:lhsmtool_posix.0 Request processed in 161us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.429858:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 59 00000100:00100000:3.0:1788925300.434387:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.435053:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462359296 00000100:00100000:1.0:1788925300.435064:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462359296 00000100:00100000:1.0:1788925300.435162:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:1.0:1788925300.435172:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+38:18829:x1875823462359296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788925300.435191:0:23891:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.435211:0:23891:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242b5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f37fd expref: -99 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788925300.435594:0:23891:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x23:0x0], count =31 00000004:00080000:1.0:1788925300.435600:0:23891:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788925300.435631:0:23891:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1788925300.435859:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf74242bc lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.435873:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf74242bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.435884:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf74242bc lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.435958:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242b5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37fd expref: 41 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.435976:0:23891:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf74242bc lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37fd expref: 40 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.435984:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a5026f2e00) 00010000:00010000:1.0:1788925300.435987:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788925300.435990:0:23891:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22400, rc 0) 00000100:00100000:1.0:1788925300.436109:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+40:18829:x1875823462359296:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 939us (1731us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788925300.436117:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 60 00000100:00100000:3.0:1788925300.440851:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.441033:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462359552 00000100:00100000:2.0:1788925300.441043:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462359552 00000100:00100000:2.0:1788925300.441105:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:2.0:1788925300.441130:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+40:18829:x1875823462359552:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.441191:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.441218:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf74242bc lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37fd expref: 40 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.441236:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a5026f2e00) 00010000:00010000:2.0:1788925300.441247:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925300.441272:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.441286:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.441296:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.441356:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442204:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442214:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442260:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442266:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442285:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442291:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08a00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.442296:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442303:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442311:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:2.0:1788925300.442314:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925300.442318:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442323:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242ca lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442335:0:22632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442340:0:22632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442346:0:22632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442351:0:22632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:2.0:1788925300.442354:0:22632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442369:0:22632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442378:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xd669d3d1 (ffff97a602c31f00) 00010000:00010000:2.0:1788925300.442380:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788925300.442383:0:22632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.442388:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08000/0x45e32cfaf74242d1 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xd669d3d1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.442494:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+39:18829:x1875823462359552:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 1364us (1650us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788925300.442503:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 61 00000100:00100000:3.0:1788925300.444812:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.444932:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462359680 00000100:00100000:2.0:1788925300.444942:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462359680 00000100:00100000:2.0:1788925300.444999:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:2.0:1788925300.445009:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+39:18829:x1875823462359680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.445028:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.445051:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf74242d8 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3804 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445083:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74242df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445095:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74242df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445105:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74242df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445217:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf74242d8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3804 expref: 41 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445237:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09c00/0x45e32cfaf74242df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3804 expref: 40 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.445245:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:2.0:1788925300.445248:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788925300.445251:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09c00, rc 0) 00000100:00100000:2.0:1788925300.445308:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+40:18829:x1875823462359680:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 300us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.445315:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 62 00000100:00100000:3.0:1788925300.448311:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.448454:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462359936 00000100:00100000:1.0:1788925300.448464:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462359936 00000100:00100000:1.0:1788925300.448516:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:1.0:1788925300.448527:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+40:18829:x1875823462359936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788925300.448601:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.448618:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.448629:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788925300.448802:0:22634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:1.0:1788925300.448813:0:22634:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 686614409973ns, next at 687614407520ns, rc = 0 00000004:00010000:1.0:1788925300.448874:0:22634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dfdec901 reply state 00000000c0d5e2f1 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.448888:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.448896:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:1.0:1788925300.448899:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788925300.448903:0:22634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788925300.449000:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+42:18829:x1875823462359936:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 474us (697us total) trans 12884901917 rc 0/0 00000100:00100000:1.0:1788925300.449007:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 63 00000100:00100000:3.0:1788925300.452275:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.452360:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360064 00000100:00100000:2.0:1788925300.452378:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360064 00000100:00100000:2.0:1788925300.452467:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:2.0:1788925300.452477:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+42:18829:x1875823462360064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.452500:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.452519:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f380b expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.452575:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 43 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.452590:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 43 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.452629:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:2.0:1788925300.452632:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788925300.452636:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09000, rc 0) 00000100:00100000:2.0:1788925300.452699:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+43:18829:x1875823462360064:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 223us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.452706:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 64 00000100:00100000:3.0:1788925300.455929:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925300.456043:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360192 00000100:00100000:0.0:1788925300.456053:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360192 00000100:00100000:0.0:1788925300.456128:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00100000:0.0:1788925300.456138:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2388:x1875823462360192:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788925300.456379:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+6:2388:x1875823462360192:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 232us (447us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788925300.456388:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 26 00000100:00080000:3.0:1788925300.456828:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925300.459799:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.459934:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360448 00000100:00100000:1.0:1788925300.459943:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360448 00000100:00100000:1.0:1788925300.459999:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:1.0:1788925300.460008:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+43:18829:x1875823462360448:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788925300.460204:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+44:18829:x1875823462360448:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 197us (414us total) trans 12884901918 rc 0/0 00000100:00100000:1.0:1788925300.460212:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 11 00000100:00100000:2.0:1788925300.463851:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.464027:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360704 00000100:00100000:1.0:1788925300.464036:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360704 00000100:00100000:1.0:1788925300.464094:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:1.0:1788925300.464103:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a50416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+44:18829:x1875823462360704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788925300.464211:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a50416f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+44:18829:x1875823462360704:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 108us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.464218:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 65 00000100:00100000:3.0:1788925300.467000:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.467104:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360832 00000100:00100000:2.0:1788925300.467114:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360832 00000100:00100000:2.0:1788925300.467170:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:2.0:1788925300.467180:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+44:18829:x1875823462360832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.467201:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.467221:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf74242f4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3812 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467287:0:22633:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467300:0:22633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467312:0:22633:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788925300.467354:0:22633:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788925300.467383:0:22633:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22633 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467466:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf74242f4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3812 expref: 46 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467485:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3812 expref: 45 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.467493:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:2.0:1788925300.467497:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788925300.467500:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd08a00, rc 0) 00000100:00100000:2.0:1788925300.467550:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+45:18829:x1875823462360832:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 371us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.467557:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 66 00000100:00100000:3.0:1788925300.473489:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.473675:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462360960 00000100:00100000:1.0:1788925300.473695:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462360960 00000100:00100000:1.0:1788925300.473754:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:1.0:1788925300.473763:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+6:2387:x1875823462360960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788925300.473779:0:24137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.474226:0:24137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3819 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788925300.474251:0:24137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa0d574, blocks: 0x0 00010000:00010000:1.0:1788925300.474271:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1788925300.474275:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925300.474283:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 7 pid: 24137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.474301:0:24137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 7 pid: 24137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.474312:0:24137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23000, rc 0) 00000100:00100000:1.0:1788925300.474371:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:2387:x1875823462360960:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 610us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.474379:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 27 00000100:00100000:3.0:1788925300.478170:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.478269:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361216 00000100:00100000:1.0:1788925300.478279:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361216 00000100:00100000:1.0:1788925300.478337:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:1.0:1788925300.478347:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+45:18829:x1875823462361216:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788925300.478952:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+45:18829:x1875823462361216:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 605us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.478977:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 67 00000100:00100000:3.0:1788925300.487095:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.487180:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361344 00000100:00100000:2.0:1788925300.487190:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361344 00000100:00100000:2.0:1788925300.487248:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 68 00000100:00100000:2.0:1788925300.487258:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+45:18829:x1875823462361344:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788925300.496575:0:22612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1788925300.496592:0:22612:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788925300.496667:0:22612:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:1.0:1788925300.496803:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+20:18829:x1875823462361344:12345-192.168.206.51@tcp:44:lhsmtool_posix.0 Request processed in 9543us (9711us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.496812:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 68 00010000:00010000:3.0:1788925300.497148:0:3608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497159:0:3608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497166:0:3608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497172:0:3608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08600 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:3.0:1788925300.497176:0:3608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497185:0:3608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497199:0:3608:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:3.0:1788925300.497201:0:3608:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788925300.497205:0:3608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.497212:0:3608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08600/0x45e32cfaf7424118 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.498476:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788925300.498494:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a50416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470860928:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788925300.498560:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.499255:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925300.499280:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470860928 00000100:00100000:3.0:1788925300.499288:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470860928 00000100:00080000:3.0:1788925300.499313:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788925300.499346:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361472 00000100:00100000:3.0:1788925300.499349:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361472 00000100:00100000:3.0:1788925300.499458:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788925300.499468:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470860928:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788925300.499595:0:24673:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788925300.499598:0:24673:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788925300.499600:0:24673:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788925300.499602:0:24673:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788925300 -> 1788925300 00002000:00010000:3.0:1788925300.499605:0:24673:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788925300.500000:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3624:x1875823470860928:12345-0@lo:2:osp-syn-1-0.0 Request processed in 532us (1438us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788925300.500008:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788925300.500026:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:3.0:1788925300.500034:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:2388:x1875823462361472:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788925300.500092:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:2388:x1875823462361472:12345-192.168.206.51@tcp:16:lhsmtool_posix.0 Request processed in 59us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925300.500097:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000004:00080000:3.0:1788925300.500145:0:3624:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff97a50416c000/2, rc 0, transno 12884901892 00000100:00100000:3.0:1788925300.500151:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a50416c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470860928:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788925300.501208:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501222:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501229:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501235:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501239:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501246:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501263:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff97a502623500) 00010000:00010000:0.0:1788925300.501266:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501270:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501276:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985000/0x45e32cfaf74240c4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501296:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501301:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501319:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501324:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fde0000 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501326:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501331:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501339:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:0.0:1788925300.501341:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501344:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501349:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0000/0x45e32cfaf74240cb lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501360:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501366:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501371:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501377:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd09200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501379:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501395:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501421:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff97a602c31500) 00010000:00010000:0.0:1788925300.501424:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501432:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501438:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09200/0x45e32cfaf7424173 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501454:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501521:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501527:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501532:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22c00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501534:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501540:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501547:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925300.501549:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501552:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501564:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf74241f8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501576:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501580:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501585:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501589:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501591:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501596:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501604:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925300.501606:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501608:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501614:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742421b lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501623:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501630:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501642:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501647:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22800 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501650:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501669:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501677:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:0.0:1788925300.501679:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788925300.501682:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501687:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22800/0x45e32cfaf7424261 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501698:0:3607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501704:0:3607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501710:0:3607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501714:0:3607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22e00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:0.0:1788925300.501717:0:3607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501731:0:3607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501739:0:3607:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:0.0:1788925300.501741:0:3607:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788925300.501743:0:3607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.501749:0:3607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22e00/0x45e32cfaf74242e6 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.518381:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.520195:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361728 00000100:00100000:2.0:1788925300.520209:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361728 00000100:00100000:2.0:1788925300.520286:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:2.0:1788925300.520298:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+14:18829:x1875823462361728:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788925300.520346:0:22632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.520374:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08a00/0x45e32cfaf74242fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3812 expref: 14 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.520393:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:2.0:1788925300.520447:0:22632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788925300.520489:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424309 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.520502:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424309 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.520512:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424309 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788925300.520624:0:22632:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5d23563 reply state 000000008fe7da0e transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424309 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.520646:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08e00/0x45e32cfaf7424309 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.520660:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:2.0:1788925300.520663:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788925300.520666:0:22632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788925300.520768:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+15:18829:x1875823462361728:12345-192.168.206.51@tcp:36:lhsmtool_posix.0 Request processed in 472us (2407us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788925300.520776:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 69 00000100:00100000:3.0:1788925300.528557:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.528693:0:24673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361856 00000100:00100000:1.0:1788925300.528702:0:24673:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361856 00000100:00100000:1.0:1788925300.528766:0:24673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1788925300.528777:0:24673:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+7:18829:x1875823462361856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788925300.528793:0:24673:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.528811:0:24673:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3820 expref: -99 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.528846:0:24673:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.528856:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925300.528861:0:24673:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925300.528866:0:24673:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 8 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.528898:0:24673:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.528922:0:24673:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.528935:0:24673:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24673:1875823470861056:192.168.206.51@tcp:104: 00000100:00100000:1.0:1788925300.529063:0:24673:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a602aca780 going to sleep for 11 seconds 00000100:00100000:1.0:1788925300.536908:0:24673:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a63f7b4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:24673:1875823470861056:192.168.206.51@tcp:104: 00010000:00010000:1.0:1788925300.536948:0:24673:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 8 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.536970:0:24673:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22a00, rc 0) 00000100:00100000:1.0:1788925300.537071:0:24673:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:6568d3b8-2ff7-4199-8339-dd9864737580+8:18829:x1875823462361856:12345-192.168.206.51@tcp:101:lhsmtool_posix.0 Request processed in 8295us (8522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.537080:0:24673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:1.0:1788925300.543322:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.543432:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462361984 00000100:00100000:2.0:1788925300.543441:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462361984 00010000:00010000:2.0:1788925300.543492:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.543539:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:2.0:1788925300.543549:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+8:2387:x1875823462361984:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925300.543563:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.543597:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.543612:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.543647:0:22618:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a1449889/0x45e32cfaf7424302 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3819 expref: 8 pid: 24137 timeout: 786 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.543673:0:22618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925300.543677:0:22618:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788925300.543683:0:22618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 7 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.543692:0:22618:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 7 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.543731:0:22618:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 7 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.543755:0:22618:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5010ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22618:1875823470861184:192.168.206.51@tcp:105: 00000100:00100000:2.0:1788925300.543889:0:22618:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a6011cac00 going to sleep for 11 seconds 00000100:00100000:3.0:1788925300.552166:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.552547:0:22618:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5010ae300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:22618:1875823470861184:192.168.206.51@tcp:105: 00010000:00010000:2.0:1788925300.552569:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788925300.552707:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362112 00000100:00100000:1.0:1788925300.552714:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362112 00000100:00100000:1.0:1788925300.552777:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1788925300.552787:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+8:2387:x1875823462362112:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788925300.552937:0:24137:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788925300.552940:0:24137:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788925300 00002000:00010000:1.0:1788925300.552943:0:24137:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788925297 00002000:00010000:1.0:1788925300.552945:0:24137:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1788925300 -> 1788925300 00002000:00010000:1.0:1788925300.552948:0:24137:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:2.0:1788925300.553007:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+9:2387:x1875823462361984:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 9460us (9693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.553024:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 20 00000100:00100000:1.0:1788925300.553193:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+8:2387:x1875823462362112:12345-192.168.206.51@tcp:2:lhsmtool_posix.0 Request processed in 407us (1035us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788925300.553201:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:1.0:1788925300.557281:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925300.557381:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362240 00000100:00100000:3.0:1788925300.557390:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362240 00000100:00100000:3.0:1788925300.557967:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:3.0:1788925300.557978:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+8:2387:x1875823462362240:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788925300.558019:0:24139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.558040:0:24139:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 8 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.558050:0:24139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788925300.558059:0:24139:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788925300.558064:0:24139:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.558154:0:24139:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 8 pid: 24673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.558168:0:24139:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 8 pid: 24673 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.558183:0:24139:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24139:1875823470861312:192.168.206.51@tcp:104: 00000100:00100000:3.0:1788925300.558283:0:24139:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788925300.563820:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925300.564126:0:24139:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:24139:1875823470861312:192.168.206.51@tcp:104: 00010000:00010000:3.0:1788925300.564156:0:24139:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.564194:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362368 00000100:00100000:1.0:1788925300.564200:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362368 00010000:00010000:1.0:1788925300.564235:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 9 pid: 24673 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.564272:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 21 00000100:00100000:1.0:1788925300.564281:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+9:2387:x1875823462362368:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788925300.564294:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925300.564314:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 9 pid: 24673 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.564325:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 9 pid: 24673 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.564346:0:22620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000da1f701e/0x45e32cfaf7424310 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.206.51@tcp remote: 0x9632377f397f3820 expref: 9 pid: 24673 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.564362:0:22620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925300.564469:0:22620:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788925300.564475:0:22620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.564496:0:22620:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.564525:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925300.564559:0:24139:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564568:0:24139:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.564580:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+8:2387:x1875823462362368:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 299us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.564586:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 21 00010000:00010000:3.0:1788925300.564587:0:24139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564594:0:24139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564602:0:24139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564609:0:24139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985e00 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:3.0:1788925300.564614:0:24139:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564623:0:24139:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564646:0:24139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.564674:0:24139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000818d10b3/0x45e32cfaf7424317 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24139 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.564718:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6568d3b8-2ff7-4199-8339-dd9864737580+7:2387:x1875823462362240:12345-192.168.206.51@tcp:1:lhsmtool_posix.0 Request processed in 6742us (7448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925300.564726:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 32 00000100:00100000:1.0:1788925300.570726:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:3.0:1788925300.572677:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362624 00000100:00100000:3.0:1788925300.572691:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362624 00000100:00100000:3.0:1788925300.572779:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 70 00000100:00100000:3.0:1788925300.572790:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+15:18829:x1875823462362624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788925300.572876:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.572892:0:23891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 15 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.572901:0:23891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.572932:0:23891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 15 pid: 23891 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.572944:0:23891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 15 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.572957:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861440:192.168.206.51@tcp:104: 00000100:00100000:3.0:1788925300.573051:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788925300.579521:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.579673:0:22618:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362752 00000100:00100000:2.0:1788925300.579684:0:22618:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362752 00010000:00010000:2.0:1788925300.579725:0:22618:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 16 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788925300.579774:0:22618:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 22 00000100:00100000:2.0:1788925300.579784:0:22618:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+16:2388:x1875823462362752:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788925300.579809:0:22618:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788925300.579816:0:22618:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 16 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579830:0:22618:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 16 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579851:0:22618:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.579857:0:22618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 16 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579868:0:22618:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579875:0:22618:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579883:0:22618:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.579915:0:22618:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788925300.579969:0:22618:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6568d3b8-2ff7-4199-8339-dd9864737580+16:2388:x1875823462362752:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 186us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.579976:0:22618:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 22 00010000:00010000:3.0:1788925300.580186:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fde0a00/0x45e32cfaf74241f1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f37be expref: 15 pid: 23891 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.580202:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861440:192.168.206.51@tcp:104: 00010000:00010000:3.0:1788925300.580221:0:23891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580229:0:23891:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580234:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580482:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580494:0:23891:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 15 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580501:0:23891:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580529:0:23891:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 15 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.580541:0:23891:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 15 pid: 22633 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.580554:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861568:192.168.206.51@tcp:104: 00000100:00100000:3.0:1788925300.580716:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788925300.595980:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861568:192.168.206.51@tcp:104: 00010000:00010000:3.0:1788925300.596008:0:23891:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788925300.597001:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.597044:0:22620:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462362880 00000100:00100000:1.0:1788925300.597051:0:22620:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462362880 00010000:00010000:1.0:1788925300.597087:0:22620:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 16 pid: 22633 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.597131:0:22620:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 23 00000100:00100000:1.0:1788925300.597140:0:22620:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+16:2387:x1875823462362880:12345-192.168.206.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788925300.597153:0:22620:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788925300.597161:0:22620:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 16 pid: 22633 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597173:0:22620:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 16 pid: 22633 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597193:0:22620:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09000/0x45e32cfaf74242ed lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.51@tcp remote: 0x9632377f397f380b expref: 16 pid: 22633 timeout: 786 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597209:0:22620:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:1.0:1788925300.597226:0:22620:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597236:0:22620:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597243:0:22620:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.597273:0:22620:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788925300.597296:0:23891:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.597304:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.597328:0:22620:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef22c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6568d3b8-2ff7-4199-8339-dd9864737580+15:2387:x1875823462362880:12345-192.168.206.51@tcp:103:ldlm_bl.0 Request processed in 189us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.597335:0:22620:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 23 00000001:00080000:3.0:1788925300.597418:0:23891:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:3.0:1788925300.597530:0:23891:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:3.0:1788925300.597563:0:23891:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:3.0:1788925300.598055:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23891:1875823470861696:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788925300.598115:0:23891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.598151:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788925300.599274:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470861696 00000100:00100000:0.0:1788925300.599283:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470861696 00000100:00100000:0.0:1788925300.599342:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788925300.599351:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23891:x1875823470861696:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788925300.599486:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:23891:x1875823470861696:12345-0@lo:1000:mdt00_003.0 Request processed in 136us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925300.599493:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788925300.599787:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a5036d9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23891:1875823470861696:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788925300.599974:0:23891:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:3.0:1788925300.600044:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23891:1875823470861824:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788925300.600079:0:23891:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.600102:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925300.600338:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470861824 00000100:00100000:0.0:1788925300.600343:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470861824 00000100:00100000:0.0:1788925300.600393:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788925300.600428:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:23891:x1875823470861824:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788925300.600535:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:23891:x1875823470861824:12345-0@lo:1000:mdt00_003.0 Request processed in 135us (455us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788925300.600543:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788925300.600774:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:23891:1875823470861824:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1788925300.600811:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600830:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600849:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600855:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985e00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:3.0:1788925300.600859:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600868:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600882:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:3.0:1788925300.600885:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788925300.600890:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600896:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985e00/0x45e32cfaf7424325 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600929:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600935:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600941:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600946:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:3.0:1788925300.600949:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600965:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600973:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:3.0:1788925300.600976:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788925300.600982:0:23891:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.600993:0:23891:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.601002:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788925300.601049:0:23891:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23a00/0x45e32cfaf7424284 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f37ef expref: 18 pid: 22634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788925300.601061:0:23891:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861952:192.168.206.51@tcp:105: 00000100:00100000:3.0:1788925300.601125:0:23891:0:(client.c:2716:ptlrpc_set_wait()) set ffff97a604f2e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788925300.605127:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.605221:0:23891:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a0380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23891:1875823470861952:192.168.206.51@tcp:105: 00010000:00010000:1.0:1788925300.605249:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605259:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742427d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605290:0:23891:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605303:0:23891:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605314:0:23891:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605325:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605348:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605354:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605359:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:1.0:1788925300.605363:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605371:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605382:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.605385:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925300.605388:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605394:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742432c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605425:0:23891:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605432:0:23891:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605438:0:23891:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605443:0:23891:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a62d985200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:1.0:1788925300.605452:0:23891:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605458:0:23891:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605467:0:23891:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.605470:0:23891:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788925300.605473:0:23891:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.605479:0:23891:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a62d985200/0x45e32cfaf742431e lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23891 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.605706:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6568d3b8-2ff7-4199-8339-dd9864737580+18:18829:x1875823462362624:12345-192.168.206.51@tcp:57:lhsmtool_posix.0 Request processed in 32917us (34988us total) trans 12884901924 rc 0/0 00000100:00100000:1.0:1788925300.605715:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 70 00000020:00080000:1.0:1788925300.605720:0:23891:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788925300.605793:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462363008 00000100:00100000:2.0:1788925300.605800:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462363008 00000100:00100000:2.0:1788925300.605841:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 12 00000100:00100000:2.0:1788925300.605850:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+18:18828:x1875823462363008:12345-192.168.206.51@tcp:49:bash.0 00000100:00100000:2.0:1788925300.605923:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+18:18828:x1875823462363008:12345-192.168.206.51@tcp:49:bash.0 Request processed in 75us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.605929:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 12 00000040:00080000:0.0:1788925300.606057:0:22665:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788925300.606061:0:22665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788925300.606075:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1788925300.606081:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788925300.611811:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.611941:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462363264 00000100:00100000:2.0:1788925300.611952:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462363264 00000100:00100000:2.0:1788925300.612007:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 13 00000100:00100000:2.0:1788925300.612017:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+18:18829:x1875823462363264:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788925300.612277:0:22636:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788925300.612311:0:22636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:2.0:1788925300.612345:0:22636:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612361:0:22636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612373:0:22636:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612382:0:22636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612434:0:22636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612441:0:22636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.612466:0:22636:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788925300.612559:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+20:18829:x1875823462363264:12345-192.168.206.51@tcp:35:lhsmtool_posix.0 Request processed in 542us (755us total) trans 12884901926 rc 0/0 00000100:00100000:2.0:1788925300.612567:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 13 00000020:00080000:2.0:1788925300.612572:0:22636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788925300.612642:0:22621:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788925300.612649:0:22621:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.612664:0:22621:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a61fd08800 already unused, calling callback (ffffffffc0b3b8b0) 00010000:00010000:0.0:1788925300.612667:0:22621:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.612675:0:22621:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.612686:0:22621:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff97a602c31800) 00010000:00010000:0.0:1788925300.612689:0:22621:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788925300.612693:0:22621:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.612699:0:22621:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08800/0x45e32cfaf7424333 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22636 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788925300.612710:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925300.612712:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788925300.612714:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925300.614210:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.614277:0:24137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462363392 00000100:00100000:1.0:1788925300.614285:0:24137:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462363392 00000100:00100000:1.0:1788925300.614345:0:24137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:1.0:1788925300.614356:0:24137:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+7:18828:x1875823462363392:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:1.0:1788925300.614377:0:24137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.614395:0:24137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf742433a lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3827 expref: -99 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788925300.614458:0:24137:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa0d574, atime: 0x6aa0d571, ctime: 0x6aa0d574, blocks: 0x0 00010000:00010000:1.0:1788925300.614478:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=686s v=(0 0) 00010000:00010000:1.0:1788925300.614494:0:24137:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788925300.614503:0:24137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf742433a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3827 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.614517:0:24137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000961a4b3f/0x45e32cfaf742433a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3827 expref: 8 pid: 24137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.614529:0:24137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b23c00, rc 0) 00000100:00100000:1.0:1788925300.614571:0:24137:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6568d3b8-2ff7-4199-8339-dd9864737580+8:18828:x1875823462363392:12345-192.168.206.51@tcp:101:bash.0 Request processed in 218us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.614578:0:24137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 33 00000100:00100000:3.0:1788925300.620275:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:2.0:1788925300.620373:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462363520 00000100:00100000:2.0:1788925300.620382:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462363520 00000100:00100000:2.0:1788925300.620464:0:22632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1788925300.620474:0:22632:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+20:18828:x1875823462363520:12345-192.168.206.51@tcp:101:bash.0 00010000:00010000:2.0:1788925300.620493:0:22632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788925300.620511:0:22632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08200/0x45e32cfaf7424341 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f382e expref: -99 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620549:0:22632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09800/0x45e32cfaf7424348 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620563:0:22632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09800/0x45e32cfaf7424348 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620573:0:22632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09800/0x45e32cfaf7424348 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620690:0:22632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd08200/0x45e32cfaf7424341 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f382e expref: 22 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620715:0:22632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a61fd09800/0x45e32cfaf7424348 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f382e expref: 21 pid: 22632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788925300.620722:0:22632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:2.0:1788925300.620725:0:22632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788925300.620729:0:22632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a61fd09800, rc 0) 00000100:00100000:2.0:1788925300.620798:0:22632:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6568d3b8-2ff7-4199-8339-dd9864737580+21:18828:x1875823462363520:12345-192.168.206.51@tcp:101:bash.0 Request processed in 326us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.620804:0:22632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 71 00000100:00100000:2.0:1788925300.632959:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.633049:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462363776 00000100:00100000:1.0:1788925300.633059:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462363776 00000100:00100000:1.0:1788925300.633112:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 14 00000100:00100000:1.0:1788925300.633121:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+21:18828:x1875823462363776:12345-192.168.206.51@tcp:35:bash.0 00000001:00080000:1.0:1788925300.633369:0:22636:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000100:00100000:1.0:1788925300.633536:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5010ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+23:18828:x1875823462363776:12345-192.168.206.51@tcp:35:bash.0 Request processed in 416us (585us total) trans 12884901928 rc 0/0 00000100:00100000:1.0:1788925300.633544:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 14 00000020:00080000:1.0:1788925300.633549:0:22636:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788925300.706312:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.707299:0:22633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364032 00000100:00100000:1.0:1788925300.707312:0:22633:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364032 00000100:00100000:1.0:1788925300.707375:0:22633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1788925300.707385:0:22633:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+23:18839:x1875823462364032:12345-192.168.206.51@tcp:101:lfs.0 00010000:00010000:1.0:1788925300.707439:0:22633:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788925300.707458:0:22633:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742434f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9632377f397f3835 expref: -99 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788925300.707573:0:22633:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788925300.707672:0:22633:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742434f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3835 expref: 25 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.707685:0:22633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff97a602c31d00) 00010000:00010000:1.0:1788925300.707688:0:22633:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788925300.707694:0:22633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22400/0x45e32cfaf742434f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.51@tcp remote: 0x9632377f397f3835 expref: 25 pid: 22633 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.707708:0:22633:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff97a503b22400, rc 0) 00000100:00100000:1.0:1788925300.707785:0:22633:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60913df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6568d3b8-2ff7-4199-8339-dd9864737580+24:18839:x1875823462364032:12345-192.168.206.51@tcp:101:lfs.0 Request processed in 401us (1480us total) trans 12884901929 rc 301/301 00000100:00100000:1.0:1788925300.707792:0:22633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:3.0:1788925300.711101:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.711167:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364160 00000100:00100000:1.0:1788925300.711175:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364160 00000100:00100000:1.0:1788925300.711225:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1788925300.711233:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+24:18839:x1875823462364160:12345-192.168.206.51@tcp:34:lfs.0 00010000:00010000:1.0:1788925300.711293:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711308:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711324:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711339:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711358:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711376:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711488:0:22634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711497:0:22634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711504:0:22634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788925300.711545:0:22634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711557:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711563:0:22634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711569:0:22634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711575:0:22634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22200 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:1.0:1788925300.711579:0:22634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711586:0:22634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711604:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff97a612bc4100) 00010000:00010000:1.0:1788925300.711607:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925300.711612:0:22634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711617:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22200/0x45e32cfaf742435d lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711629:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711635:0:22634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711641:0:22634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711646:0:22634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b22c00 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:1.0:1788925300.711649:0:22634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711663:0:22634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711671:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff97a5026f2800) 00010000:00010000:1.0:1788925300.711673:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925300.711676:0:22634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711681:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b22c00/0x45e32cfaf7424364 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711707:0:22634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711713:0:22634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711720:0:22634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711725:0:22634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff97a503b23400 already unused, calling callback (ffffffffc17624f0) 00010000:00010000:1.0:1788925300.711727:0:22634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711733:0:22634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711751:0:22634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff97a602c31e00) 00010000:00010000:1.0:1788925300.711753:0:22634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788925300.711756:0:22634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788925300.711761:0:22634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff97a503b23400/0x45e32cfaf742436b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788925300.711824:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+24:18839:x1875823462364160:12345-192.168.206.51@tcp:34:lfs.0 Request processed in 591us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.711831:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:2.0:1788925300.714533:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:1.0:1788925300.714681:0:22636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364416 00000100:00100000:1.0:1788925300.714690:0:22636:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364416 00000100:00100000:1.0:1788925300.714733:0:22636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:1.0:1788925300.714754:0:22636:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+24:18839:x1875823462364416:12345-192.168.206.51@tcp:35:lfs.0 00000100:00100000:1.0:1788925300.714972:0:22636:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62ef91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6568d3b8-2ff7-4199-8339-dd9864737580+25:18839:x1875823462364416:12345-192.168.206.51@tcp:35:lfs.0 Request processed in 219us (445us total) trans 12884901930 rc 0/0 00000100:00100000:1.0:1788925300.714979:0:22636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 15 00000100:00100000:0.0:1788925300.906667:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788925300.906690:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470862080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925300.906788:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925300.906840:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862080 00000100:00100000:0.0:1788925300.906847:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862080 00000100:00100000:0.0:1788925300.906901:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788925300.906909:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470862080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788925300.906935:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:0.0:1788925300.906975:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470862080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925300.906982:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1788925300.907000:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788925300.907034:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a501f29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470862080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788925300.908480:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788925300.908499:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470862208:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788925300.908548:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925300.908752:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862208 00000100:00100000:1.0:1788925300.908760:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862208 00000100:00100000:1.0:1788925300.908803:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925300.908812:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875823470862208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788925300.908831:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923501056 avail 3691978752 00000100:00100000:1.0:1788925300.908873:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f29180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3622:x1875823470862208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.908879:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788925300.908919:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3622:1875823470862208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788925300.909459:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470862464:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.909496:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.909516:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470862976:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.909536:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.909550:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470863488:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.909585:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.909602:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788925300.909608:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470862592:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.909990:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910014:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470863104:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910037:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910055:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470863616:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910073:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910099:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470862720:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910121:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910139:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470863232:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910157:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910169:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788925300.910174:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470862336:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910196:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910219:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470862848:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910249:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910266:0:3621:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470863360:0@lo:400:kworker.0 00000100:00100000:3.0:1788925300.910284:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788925300.910305:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863488 00000100:00100000:3.0:1788925300.910310:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863488 00000100:00100000:3.0:1788925300.910345:0:22632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863104 00000100:00100000:3.0:1788925300.910348:0:22632:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863104 00000100:00100000:2.0:1788925300.910559:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862976 00000100:00100000:2.0:1788925300.910563:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862976 00000100:00100000:2.0:1788925300.910588:0:24139:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862592 00000100:00100000:2.0:1788925300.910592:0:24139:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862592 00000100:00100000:2.0:1788925300.910613:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925300.910620:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910688:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875823470862976:12345-0@lo:400:kworker.0 Request processed in 68us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.910695:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788925300.910709:0:24139:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925300.910715:0:24139:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910749:0:24139:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f66a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470862592:12345-0@lo:400:kworker.0 Request processed in 27us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.910755:0:24139:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925300.910799:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470862592:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910811:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3623:1875823470862976:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910836:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863616 00000100:00100000:2.0:1788925300.910839:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863616 00000100:00100000:2.0:1788925300.910857:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862720 00000100:00100000:2.0:1788925300.910858:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862720 00000100:00100000:2.0:1788925300.910868:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863232 00000100:00100000:2.0:1788925300.910869:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863232 00000100:00100000:2.0:1788925300.910882:0:23891:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863360 00000100:00100000:2.0:1788925300.910884:0:23891:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863360 00000100:00100000:2.0:1788925300.910896:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788925300.910902:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470863488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910936:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5036d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875823470863488:12345-0@lo:400:kworker.0 Request processed in 34us (1351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.910942:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788925300.910966:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3623:1875823470863488:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.910982:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788925300.910988:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470863104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911022:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f66ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875823470863104:12345-0@lo:400:kworker.0 Request processed in 34us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911028:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788925300.911052:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875823470863104:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911068:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788925300.911074:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470863616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911103:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f66bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875823470863616:12345-0@lo:400:kworker.0 Request processed in 30us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911118:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:2.0:1788925300.911145:0:3623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62f5a0a80 x1875823470863616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925300.911155:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3623:1875823470863616:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911171:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788925300.911177:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470862720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911209:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f669880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3621:x1875823470862720:12345-0@lo:400:kworker.0 Request processed in 32us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911215:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788925300.911227:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788925300.911233:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470863232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911261:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f669180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3621:x1875823470863232:12345-0@lo:400:kworker.0 Request processed in 29us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911266:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788925300.911278:0:23891:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788925300.911284:0:23891:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470863360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911309:0:23891:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f66a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1875823470863360:12345-0@lo:400:kworker.0 Request processed in 26us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911314:0:23891:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788925300.911340:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862464 00000100:00100000:2.0:1788925300.911344:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862464 00000100:00100000:2.0:1788925300.911381:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862848 00000100:00100000:2.0:1788925300.911384:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862848 00000100:00100000:2.0:1788925300.911398:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925300.911432:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911474:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f5a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470862464:12345-0@lo:400:kworker.0 Request processed in 44us (1978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911481:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788925300.911493:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925300.911498:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470862848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911525:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f66b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1875823470862848:12345-0@lo:400:kworker.0 Request processed in 27us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925300.911531:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788925300.911556:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470862464:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911587:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3621:1875823470862848:0@lo:400:kworker.0 00010000:00080000:2.0:1788925300.911598:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff97a62f5a0000 x1875823470863360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788925316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788925300.911608:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3621:1875823470863360:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911616:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3621:1875823470862720:0@lo:400:kworker.0 00000100:00100000:2.0:1788925300.911625:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3621:1875823470863232:0@lo:400:kworker.0 00000100:00080000:0.0:1788925300.911873:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788925300.911879:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925300.911881:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788925300.912484:0:22627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470862336 00000100:00100000:1.0:1788925300.912491:0:22627:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470862336 00000100:00100000:1.0:1788925300.912530:0:22627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788925300.912538:0:22627:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3621:x1875823470862336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788925300.912592:0:22627:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608404450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6380dc84-8626-4009-8bc6-29a71e76153e+24:3621:x1875823470862336:12345-0@lo:400:kworker.0 Request processed in 55us (2394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925300.912598:0:22627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788925300.912840:0:3621:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f5a2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:6380dc84-8626-4009-8bc6-29a71e76153e:3621:1875823470862336:0@lo:400:kworker.0 00010000:00010000:3.0:1788925300.970670:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788925302.000439:0:25661:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788925302.323752:0:25716:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00000100:00100000:2.0:1788925302.445340:0:3622:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788925302.445360:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470863744:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788925302.445435:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925302.445479:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863744 00000100:00100000:2.0:1788925302.445487:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863744 00000100:00100000:2.0:1788925302.445538:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788925302.445548:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a62f666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470863744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788925302.445822:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788925302.445985:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a62f666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470863744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 439us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925302.445993:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788925302.446016:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788925302.448363:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470863744:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788925303.018671:0:22621:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925303.466674:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470863872:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788925303.466751:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788925303.466844:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a62f667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470864000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788925303.466867:0:22637:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470863872 00000100:00100000:2.0:1788925303.466877:0:22637:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470863872 00000100:00100000:1.0:1788925303.466883:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788925303.466927:0:22637:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788925303.466938:0:22637:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470863872:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788925303.466969:0:22637:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:2.0:1788925303.467020:0:22637:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3622:x1875823470863872:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925303.467021:0:24141:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470864000 00000100:00100000:2.0:1788925303.467027:0:22637:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788925303.467040:0:24141:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470864000 00000100:00080000:2.0:1788925303.467069:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788925303.467090:0:24141:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788925303.467098:0:24141:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470864000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788925303.467125:0:24141:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788925303.467140:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f668700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3622:1875823470863872:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788925303.467175:0:24141:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875823470864000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788925303.467181:0:24141:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788925303.467220:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a62f667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3623:1875823470864000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788925303.527874:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.527981:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528035:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528069:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528085:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528107:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528123:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528138:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528156:0:3614:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925303.528180:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365056 00000100:00100000:0.0:1788925303.528189:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365056 00000100:00100000:0.0:1788925303.528250:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365568 00000100:00100000:0.0:1788925303.528254:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365568 00000100:00100000:0.0:1788925303.528267:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364928 00000100:00100000:0.0:1788925303.528270:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364928 00000100:00100000:0.0:1788925303.528283:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365440 00000100:00100000:0.0:1788925303.528285:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365440 00000100:00100000:0.0:1788925303.528298:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1788925303.528307:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+8:2389:x1875823462365056:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925303.528369:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+8:2389:x1875823462365056:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 63us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925303.528377:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 28 00000100:00100000:0.0:1788925303.528439:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1788925303.528446:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365568:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925303.528470:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365568:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925303.528476:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 29 00000100:00100000:0.0:1788925303.528487:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1788925303.528492:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462364928:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925303.528524:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604898700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462364928:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 31us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925303.528531:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 30 00000100:00100000:0.0:1788925303.528541:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00100000:0.0:1788925303.528547:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365440:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:0.0:1788925303.528566:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365440:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 20us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925303.528572:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 31 00000100:00080000:0.0:1788925303.528587:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788925303.528590:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788925303.530522:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364800 00000100:00100000:1.0:1788925303.530534:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364800 00000100:00100000:1.0:1788925303.530593:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365312 00000100:00100000:1.0:1788925303.530608:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365312 00000100:00100000:1.0:1788925303.530669:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364672 00000100:00100000:1.0:1788925303.530673:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364672 00000100:00100000:1.0:1788925303.530686:0:22634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365184 00000100:00100000:1.0:1788925303.530688:0:22634:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365184 00000100:00100000:1.0:1788925303.530705:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1788925303.530714:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a501f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462364800:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925303.530780:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a501f2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+5:2389:x1875823462364800:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 67us (2799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925303.530787:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 72 00000100:00100000:1.0:1788925303.530803:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1788925303.530809:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a604899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365312:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925303.530830:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a604899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+5:2389:x1875823462365312:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 22us (2761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925303.530836:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 73 00000100:00100000:1.0:1788925303.530846:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1788925303.530852:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+25:2389:x1875823462364672:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925303.530876:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6568d3b8-2ff7-4199-8339-dd9864737580+25:2389:x1875823462364672:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 24us (2768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925303.530882:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 74 00000100:00100000:1.0:1788925303.530892:0:22634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00100000:1.0:1788925303.530898:0:22634:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a60489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2389:x1875823462365184:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:1.0:1788925303.530918:0:22634:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a60489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e4daeccf-da8c-4c27-87be-e0bd110ac0bf+6:2389:x1875823462365184:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 21us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788925303.530924:0:22634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 75 00000100:00080000:0.0:1788925303.531205:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788925303.531210:0:22628:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788925303.551395:0:22625:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462364544 00000100:00100000:2.0:1788925303.551423:0:22625:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462364544 00000100:00100000:2.0:1788925303.551499:0:22625:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:2.0:1788925303.551509:0:22625:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:2389:x1875823462364544:12345-192.168.206.51@tcp:400:kworker.0 00000100:00100000:2.0:1788925303.551578:0:22625:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a608405850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:518e9438-b998-428e-81a8-4598516dcc95+13:2389:x1875823462364544:12345-192.168.206.51@tcp:400:kworker.0 Request processed in 70us (23713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788925303.551585:0:22625:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 169 00000100:00100000:1.0:1788925303.980252:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470864128:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788925303.980352:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788925303.980594:0:23372:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823470864128 00000100:00100000:0.0:1788925303.980606:0:23372:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823470864128 00000100:00100000:0.0:1788925303.980742:0:23372:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788925303.980753:0:23372:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a63f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470864128:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788925303.980796:0:23372:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788925303.980857:0:23372:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a63f7b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875823470864128:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925303.980866:0:23372:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788925303.981020:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff97a610438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3624:1875823470864128:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788925304.051051:0:22622:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788925304.557246:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925304.557462:0:3615:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.51@tcp (source: 12345-192.168.206.51@tcp) 00000100:00100000:0.0:1788925304.557508:0:24138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365824 00000100:00100000:0.0:1788925304.557520:0:24138:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365824 00000100:00100000:0.0:1788925304.557592:0:24138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:0.0:1788925304.557603:0:24138:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a5041e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+8:2390:x1875823462365824:12345-192.168.206.51@tcp:16:kworker.0 00000100:00100000:0.0:1788925304.557791:0:24138:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a5041e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6568d3b8-2ff7-4199-8339-dd9864737580+8:2390:x1875823462365824:12345-192.168.206.51@tcp:16:kworker.0 Request processed in 189us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788925304.557799:0:24138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 34 00000100:00100000:3.0:1788925304.564836:0:24142:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875823462365696 00000100:00100000:3.0:1788925304.564861:0:24142:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875823462365696 00002000:00100000:3.0:1788925304.565167:0:24142:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff97a610438380 x1875823462365696/t0(0) o4->6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp:380/0 lens 504/0 e 0 to 0 dl 1788925315 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788925304.565182:0:24142:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a610438380 with x1875823462365696 ext(0->8) 00002000:00010000:3.0:1788925304.565191:0:24142:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a610438380 00000100:00100000:3.0:1788925304.565272:0:24142:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.51@tcp, seq: 0 00000100:00100000:3.0:1788925304.565284:0:24142:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff97a610438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6568d3b8-2ff7-4199-8339-dd9864737580+8:2390:x1875823462365696:12345-192.168.206.51@tcp:4:bash.0 00000100:00100000:3.0:1788925304.573758:0:24142:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff97a610438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6568d3b8-2ff7-4199-8339-dd9864737580+10:2390:x1875823462365696:12345-192.168.206.51@tcp:4:bash.0 Request processed in 8459us (16510us total) trans 12884901895 rc 0/0 00000100:00100000:3.0:1788925304.573777:0:24142:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.51@tcp, seq: 0 00002000:00100000:3.0:1788925304.573793:0:24142:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x42:0x0] (0->8) req@ffff97a610438380 x1875823462365696/t12884901895(0) o4->6568d3b8-2ff7-4199-8339-dd9864737580@192.168.206.51@tcp:380/0 lens 504/448 e 0 to 0 dl 1788925315 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:3.0:1788925304.573804:0:24142:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff97a610438380 with x1875823462365696 ext(0->8) 00002000:00010000:3.0:1788925304.573812:0:24142:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff97a610438380 00000040:00080000:2.0:1788925304.682911:0:22665:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788925304.682926:0:22665:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788925304.682955:0:22665:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:2.0:1788925304.682963:0:22665:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 Debug log: 14768 lines, 14768 kept, 0 dropped, 0 bad.