00000100:00100000:1.0F:1788940913.819703:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788940913.819738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944992128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788940913.819808:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0F:1788940913.820122:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992128 00000100:00100000:0.0:1788940913.820149:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992128 00000100:00100000:0.0:1788940913.820211:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940913.820222:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944992128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940913.820251:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940913.820318:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944992128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940913.820326:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788940913.820377:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944992128:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940914.595095:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0F:1788940914.851820:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:2.0:1788940914.851862:0:17130:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d02004f0c0 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:2.0:1788940914.851867:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d017c61200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d02004f480 00000020:00080000:2.0:1788940914.851870:0:17130:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff91d017c61300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d03971c200 00000020:00080000:0.0:1788940914.851996:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:0.0:1788940914.852073:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0F:1788940914.852405:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852424:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852432:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852438:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788940914.852443:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852451:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852468:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:3.0:1788940914.852471:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940914.852476:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940914.852482:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badea4c lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17152 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788940915.164082:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788940915.164092:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788940915.164122:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788940915.164131:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788940915.611511:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940915.867416:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944992256:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940915.867516:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940915.867606:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992256 00000100:00100000:0.0:1788940915.867617:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992256 00000100:00100000:0.0:1788940915.867691:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788940915.867703:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944992256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940915.867750:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940915.867807:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944992256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940915.867814:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788940915.867845:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788940915.867891:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944992256:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788940915.869486:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944992384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940915.870374:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940915.870468:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992384 00000100:00100000:1.0:1788940915.870479:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992384 00000100:00100000:1.0:1788940915.870537:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940915.870549:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944992384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940915.870597:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788940915.870652:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09678a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944992384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940915.870660:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788940915.870731:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944992384:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940915.871489:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944992512:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940915.871548:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940915.871613:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992512 00000100:00100000:0.0:1788940915.871622:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992512 00000100:00100000:0.0:1788940915.871674:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940915.871682:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944992512:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788940915.871732:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788940915.871775:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944992512:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940915.871783:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788940915.871828:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944992512:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940916.010731:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010785:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010810:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010834:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010860:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010893:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940916.010934:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830272 00000100:00100000:3.0:1788940916.010949:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830272 00000100:00100000:3.0:1788940916.011018:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:3.0:1788940916.011043:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921830272:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940916.011152:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921830272:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 111us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.011161:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:3.0:1788940916.011202:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830528 00000100:00100000:3.0:1788940916.011207:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830528 00000100:00100000:3.0:1788940916.011287:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830912 00000100:00100000:3.0:1788940916.011291:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830912 00000100:00100000:3.0:1788940916.011310:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830400 00000100:00100000:3.0:1788940916.011313:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830400 00000100:00100000:3.0:1788940916.012522:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831040 00000100:00080000:0.0:1788940916.012664:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940916.012671:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940916.013427:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831040 00000100:00100000:3.0:1788940916.013498:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:3.0:1788940916.013510:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921830528:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940916.013943:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921830528:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 433us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.013953:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:3.0:1788940916.013978:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:3.0:1788940916.013987:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921830912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940916.014016:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921830912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 31us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.014022:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:3.0:1788940916.014036:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:3.0:1788940916.014043:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:2406:x1875839921830400:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940916.014071:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:2406:x1875839921830400:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 29us (3236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.014095:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 77 00000100:00100000:3.0:1788940916.014119:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:3.0:1788940916.014127:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921831040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940916.014156:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921831040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 30us (3262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.014162:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 78 00000100:00100000:3.0:1788940916.014200:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830656 00000100:00100000:3.0:1788940916.014206:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830656 00000100:00100000:3.0:1788940916.014281:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:3.0:1788940916.014290:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921830656:12345-192.168.202.25@tcp:400:kworker.0 00000100:00080000:1.0:1788940916.015652:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940916.015661:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788940916.016019:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921830656:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 1722us (5149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940916.016031:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:1.0:1788940916.022727:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940916.022840:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940916.022875:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940916.023018:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921830784 00000100:00100000:1.0:1788940916.023030:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921830784 00000100:00100000:1.0:1788940916.023101:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831168 00000100:00100000:1.0:1788940916.023117:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831168 00000100:00100000:1.0:1788940916.023137:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831296 00000100:00100000:1.0:1788940916.023158:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831296 00000100:00100000:1.0:1788940916.023181:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940916.023192:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2403:x1875839921830784:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1788940916.023233:0:19149:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade782 00000100:00080000:1.0:1788940916.023253:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91cf01637000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940916.023347:0:19149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788940916.023550:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+2:2403:x1875839921830784:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 359us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940916.023559:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788940916.023577:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1788940916.023583:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2403:x1875839921831168:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1788940916.023596:0:19149:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade7ba 00000100:00080000:1.0:1788940916.023603:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91d03473e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940916.023627:0:19149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788940916.023706:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09679f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+2:2403:x1875839921831168:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 121us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940916.023713:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1788940916.023725:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:1.0:1788940916.023732:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2403:x1875839921831296:12345-192.168.202.25@tcp:9:kworker.0 00000020:00000080:1.0:1788940916.023746:0:19149:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade7c1 00000100:00080000:1.0:1788940916.023751:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940916.023776:0:19149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:1.0:1788940916.023827:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+2:2403:x1875839921831296:12345-192.168.202.25@tcp:9:kworker.0 Request processed in 94us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940916.023835:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00010000:00010000:1.0:1788940916.023909:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940916.023923:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940916.023930:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940916.023941:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788940916.023946:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788940916.635460:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940917.329544:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940917.329655:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831424 00000100:00100000:0.0:1788940917.329673:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831424 00000100:00100000:0.0:1788940917.329778:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:0.0:1788940917.329791:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:15646:x1875839921831424:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788940917.329936:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:15646:x1875839921831424:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 147us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.329945:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:0.0:1788940917.346227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940917.357329:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831552 00000100:00100000:3.0:1788940917.357357:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831552 00000100:00100000:3.0:1788940917.357880:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788940917.357895:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15646:x1875839921831552:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788940917.358047:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:15646:x1875839921831552:12345-192.168.202.25@tcp:60:lhsmtool_posix.0 Request processed in 156us (11833us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.358055:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:1.0:1788940917.381992:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940917.383733:0:17153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831808 00000100:00100000:3.0:1788940917.383754:0:17153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831808 00000100:00100000:3.0:1788940917.383845:0:17153:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:3.0:1788940917.383859:0:17153:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:15646:x1875839921831808:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788940917.384227:0:17153:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+14:15646:x1875839921831808:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 369us (2248us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788940917.384236:0:17153:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00010000:00010000:1.0:1788940917.662028:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940917.915932:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0967b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944992640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940917.916032:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940917.916174:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992640 00000100:00100000:1.0:1788940917.916187:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992640 00000100:00100000:1.0:1788940917.916298:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788940917.916333:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944992640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788940917.916376:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940917.916467:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944992640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 156us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940917.916476:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788940917.916685:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940917.916815:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944992896:0@lo:400:kworker.0 00000100:00100000:2.0:1788940917.916830:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944993024:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.916896:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944993152:0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.916968:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944992768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940917.922612:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.922673:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944993664:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.922720:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.922741:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944994176:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.922799:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.922913:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994176 00000100:00100000:0.0:1788940917.922928:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994176 00000100:00100000:3.0:1788940917.923079:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.923107:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788940917.923133:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944994176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944993408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923225:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940917.923281:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944993920:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923311:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940917.923331:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940917.923338:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944994048:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923356:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940917.923390:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993920 00000100:00100000:3.0:1788940917.923396:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993920 00000100:00100000:3.0:1788940917.923431:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994048 00000100:00100000:3.0:1788940917.923434:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994048 00000100:00100000:3.0:1788940917.923451:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940917.923459:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944993920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923514:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944993920:12345-0@lo:400:kworker.0 Request processed in 56us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.923522:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788940917.923539:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940917.923544:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944994048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.923567:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944994048:12345-0@lo:400:kworker.0 Request processed in 23us (209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.923586:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940917.923605:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992896 00000100:00100000:3.0:1788940917.923609:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992896 00000100:00100000:3.0:1788940917.923637:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940917.923645:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944992896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.924707:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944992896:12345-0@lo:400:kworker.0 Request processed in 1056us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.924719:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788940917.924848:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993408 00000100:00100000:3.0:1788940917.924856:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993408 00000100:00100000:3.0:1788940917.924901:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788940917.924908:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944993408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925120:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944993408:12345-0@lo:400:kworker.0 Request processed in 212us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.925126:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:3.0:1788940917.925185:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d70380 x1875839944994048/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940917.925204:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944994048:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925220:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944993920:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925230:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944992896:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925241:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944993408:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925337:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993152 00000100:00100000:3.0:1788940917.925342:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993152 00000100:00100000:3.0:1788940917.925372:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993664 00000100:00100000:3.0:1788940917.925387:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993664 00000100:00100000:3.0:1788940917.925412:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940917.925418:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944993152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.925453:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944993152:12345-0@lo:400:kworker.0 Request processed in 36us (2854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.925460:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788940917.925471:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788940917.925477:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944993664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.925544:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839944994176:12345-0@lo:400:kworker.0 Request processed in 2413us (2733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.925562:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788940917.925610:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944993664:12345-0@lo:400:kworker.0 Request processed in 130us (2887us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.925620:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1788940917.925624:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940917.925631:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940917.925638:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940917.925641:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940917.925706:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839944994176:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.925734:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0967b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944992640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788940917.925775:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944993152:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.925943:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944993664:0@lo:400:kworker.0 00000100:00100000:2.0:1788940917.928399:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940917.928448:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944993536:0@lo:400:kworker.0 00000100:00100000:2.0:1788940917.928491:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.928579:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993024 00000100:00100000:0.0:1788940917.928588:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993024 00000100:00100000:0.0:1788940917.928648:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788940917.928658:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944993024:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.928721:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944993024:12345-0@lo:400:kworker.0 Request processed in 65us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.928729:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788940917.928795:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944993024:0@lo:400:kworker.0 00000100:00100000:3.0:1788940917.929688:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993536 00000100:00100000:3.0:1788940917.929704:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993536 00000100:00100000:3.0:1788940917.929818:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940917.929830:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944993536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788940917.929932:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940917.929935:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944993536:12345-0@lo:400:kworker.0 Request processed in 107us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940917.929946:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788940917.930347:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944993536:0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.931799:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940917.931868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944993280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.931928:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940917.931960:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944993792:0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.931984:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940917.932008:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944992768 00000100:00100000:1.0:1788940917.932017:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944994304:0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.932028:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944992768 00000100:00100000:1.0:1788940917.932040:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940917.932104:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993280 00000100:00100000:1.0:1788940917.932112:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993280 00000100:00100000:0.0:1788940917.932143:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940917.932161:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944993792 00000100:00100000:0.0:1788940917.932161:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944992768:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788940917.932165:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944993792 00000100:00100000:1.0:1788940917.932186:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994304 00002000:00000024:0.0:1788940917.932200:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788940917.932206:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994304 00000100:00100000:1.0:1788940917.932249:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788940917.932291:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944993280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.932340:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09679c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944992768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 183us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.932350:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788940917.932368:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839944993280:12345-0@lo:400:kworker.0 Request processed in 108us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940917.932377:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788940917.932397:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788940917.932406:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944993792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940917.932417:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788940917.932432:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944994304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.932447:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09679880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944993792:12345-0@lo:400:kworker.0 Request processed in 42us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940917.932455:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1788940917.932586:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940917.933022:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944992768:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940917.935375:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09678700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944994304:12345-0@lo:400:kworker.0 Request processed in 2934us (3321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940917.935392:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788940917.947296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839944993280:0@lo:400:kworker.0 00000100:00100000:1.0:1788940917.947330:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944993792:0@lo:400:kworker.0 00010000:00080000:1.0:1788940917.947351:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d70e00 x1875839944994304/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940933 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940917.947364:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944994304:0@lo:400:kworker.0 00010000:00010000:1.0:1788940918.684550:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940918.939641:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944994432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940918.939741:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940918.939869:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994432 00000100:00100000:0.0:1788940918.939881:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994432 00000100:00100000:0.0:1788940918.939982:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788940918.939994:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944994432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940918.940036:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940918.940134:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d018b0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944994432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940918.940142:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788940918.940360:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944994432:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940919.708580:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788940920.486347:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1788940920.486361:0:17130:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:0.0:1788940920.486431:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:0.0:1788940920.486443:0:17189:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:3.0:1788940920.734316:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940920.987630:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940920.987652:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944994560:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788940920.987721:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940920.987988:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994560 00000100:00100000:1.0:1788940920.987997:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994560 00000100:00100000:1.0:1788940920.988043:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940920.988072:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944994560:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788940920.988110:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788940920.988156:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944994560:12345-0@lo:41:osp-pre-0-1.0 Request processed in 97us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.988163:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788940920.988221:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944994560:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940920.989090:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944994816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940920.989135:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940920.989170:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944994688:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788940920.989193:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940920.989223:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994688 00000100:00100000:0.0:1788940920.989234:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994688 00000100:00100000:0.0:1788940920.989283:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940920.989291:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944994688:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788940920.989404:0:18671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994816 00000100:00100000:1.0:1788940920.989409:0:18671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994816 00000100:00100000:1.0:1788940920.989448:0:18671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788940920.989456:0:18671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944994816:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788940920.989477:0:18671:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1788940920.989513:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788940920.989514:0:18671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944994816:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940920.989521:0:18671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000004:00000024:0.0:1788940920.989602:0:17156:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788940920.989636:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944994688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 347us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940920.989642:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788940920.989679:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944994816:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788940920.989692:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf09678e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944994688:0@lo:41:osp-pre-1-0.0 00000001:02000400:1.0:1788940921.061105:0:20539:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 04:02:00 (1788940920) 00000100:00100000:0.0:1788940921.134522:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134567:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134593:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134616:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134640:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134667:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940921.134698:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832192 00000100:00100000:0.0:1788940921.134708:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832192 00000100:00100000:0.0:1788940921.134757:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832448 00000100:00100000:0.0:1788940921.134760:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832448 00000100:00100000:0.0:1788940921.134773:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832064 00000100:00100000:0.0:1788940921.134776:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832064 00000100:00100000:0.0:1788940921.134789:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832576 00000100:00100000:0.0:1788940921.134791:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832576 00000100:00100000:0.0:1788940921.134807:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:0.0:1788940921.134817:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921832192:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940921.134884:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921832192:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.134902:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 85 00000100:00100000:0.0:1788940921.134923:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1788940921.134930:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921832448:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940921.134957:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2406:x1875839921832448:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.134962:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 86 00000100:00100000:0.0:1788940921.134975:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1788940921.134981:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:2406:x1875839921832064:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940921.135007:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:2406:x1875839921832064:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.135013:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 87 00000100:00100000:0.0:1788940921.135025:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1788940921.135031:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921832576:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940921.135053:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2406:x1875839921832576:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.135070:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 88 00000100:00100000:0.0:1788940921.135094:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832320 00000100:00100000:0.0:1788940921.135097:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832320 00000100:00100000:0.0:1788940921.135128:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:0.0:1788940921.135135:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921832320:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940921.135160:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2406:x1875839921832320:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940921.135167:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00080000:0.0:1788940921.135196:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940921.135201:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788940921.135203:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788940921.135296:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921831936 00000100:00100000:2.0:1788940921.135301:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921831936 00000100:00100000:2.0:1788940921.135402:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 172 00000100:00100000:2.0:1788940921.135409:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921831936:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788940921.135435:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2406:x1875839921831936:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 27us (924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940921.135441:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 172 00000001:00100000:1.0:1788940921.508770:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000020:00000080:1.0:1788940921.508780:0:18664:0:(genops.c:893:class_export_put()) final put ffff91d03473c800/50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000020:00000080:2.0:1788940921.510355:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473c800/50c55b2b-64be-4d2b-a01b-9a1815d64f2a for lustre-OST0000 00000020:00000080:2.0:1788940921.511552:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03473e800 for lustre-OST0000 00000001:00100000:2.0:1788940921.514129:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000020:00000080:2.0:1788940921.514138:0:19484:0:(genops.c:893:class_export_put()) final put ffff91cf07e0b800/50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:2.0:1788940921.514166:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:2.0:1788940921.514183:0:19484:0:(genops.c:893:class_export_put()) final put ffff91cf01632800/c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:0.0:1788940921.514313:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e0b800/50c55b2b-64be-4d2b-a01b-9a1815d64f2a for lustre-OST0001 00000020:00000080:0.0:1788940921.514360:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01632800/c6124d7c-7da2-46c0-b57e-23d795ef33aa for lustre-OST0001 00000020:00000080:0.0:1788940921.514378:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e0e000 for lustre-OST0001 00000020:00000080:0.0:1788940921.514383:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01637000 for lustre-OST0001 00010000:00010000:1.0:1788940921.755981:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788940921.822111:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788940922.779882:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940923.035772:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940923.035795:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944994944:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940923.035871:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940923.035931:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944994944 00000100:00100000:3.0:1788940923.035938:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944994944 00000100:00100000:3.0:1788940923.035992:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788940923.036001:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944994944:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940923.036031:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788940923.036084:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944994944:12345-0@lo:13:osp-pre-1-1.0 Request processed in 84us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940923.036091:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788940923.036114:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788940923.036152:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944994944:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788940923.036490:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944995072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036536:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036558:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944995584:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036579:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036593:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944996096:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036617:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036632:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940923.036637:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944995200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036672:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944995712:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036688:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036700:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944996224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036716:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940923.036740:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995584 00000100:00100000:0.0:1788940923.036744:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995584 00000100:00100000:0.0:1788940923.036772:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996096 00000100:00100000:0.0:1788940923.036774:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996096 00000100:00100000:0.0:1788940923.036788:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996224 00000100:00100000:0.0:1788940923.036790:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996224 00000100:00100000:0.0:1788940923.036802:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788940923.036816:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944995584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036849:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944995584:12345-0@lo:400:kworker.0 Request processed in 34us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.036856:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788940923.036870:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940923.036875:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944996096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036899:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839944996096:12345-0@lo:400:kworker.0 Request processed in 24us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.036905:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788940923.036915:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940923.036920:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944996224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.036941:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839944996224:12345-0@lo:400:kworker.0 Request processed in 21us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.036946:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788940923.036966:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995200 00000100:00100000:0.0:1788940923.036969:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995200 00000100:00100000:0.0:1788940923.036991:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995712 00000100:00100000:0.0:1788940923.036993:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995712 00000100:00100000:0.0:1788940923.037006:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940923.037012:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944995200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.037049:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944995200:12345-0@lo:400:kworker.0 Request processed in 27us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.037056:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788940923.037067:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940923.037072:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944995712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.037095:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944995712:12345-0@lo:400:kworker.0 Request processed in 23us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.037106:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940923.037142:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944995200:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.037152:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944995712:0@lo:400:kworker.0 00010000:00080000:0.0:1788940923.037162:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06102a00 x1875839944996224/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940923.037172:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839944996224:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.037180:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944995584:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.037188:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839944996096:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037665:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944995456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037705:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037732:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944995968:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037754:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037772:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944996480:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037804:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037825:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:1.0:1788940923.037830:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944995328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037851:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037868:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944995840:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037899:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037920:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944996352:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.037943:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940923.037968:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995456 00000100:00100000:1.0:1788940923.037973:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995456 00000100:00100000:1.0:1788940923.038006:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995328 00000100:00100000:1.0:1788940923.038009:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995328 00000100:00100000:1.0:1788940923.038026:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995840 00000100:00100000:1.0:1788940923.038029:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995840 00000100:00100000:3.0:1788940923.038055:0:17143:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995072 00000100:00100000:3.0:1788940923.038062:0:17143:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995072 00000100:00100000:1.0:1788940923.038065:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940923.038076:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944995456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940923.038102:0:17143:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788940923.038112:0:17143:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944995072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038121:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09679180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944995456:12345-0@lo:400:kworker.0 Request processed in 47us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038129:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788940923.038147:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788940923.038157:0:17143:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944995072:12345-0@lo:400:kworker.0 Request processed in 45us (1618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038158:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944995328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940923.038183:0:17143:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788940923.038199:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944995328:12345-0@lo:400:kworker.0 Request processed in 45us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038206:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788940923.038220:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940923.038227:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944995840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940923.038236:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940923.038248:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944996608:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788940923.038301:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944995840:12345-0@lo:400:kworker.0 Request processed in 74us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038307:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788940923.038331:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944995968 00000100:00100000:1.0:1788940923.038334:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944995968 00000100:00100000:1.0:1788940923.038357:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996480 00000100:00100000:1.0:1788940923.038360:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996480 00000100:00100000:1.0:1788940923.038373:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996352 00000100:00100000:1.0:1788940923.038376:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996352 00000100:00100000:1.0:1788940923.038387:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940923.038393:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf09678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944995968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038422:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf09678e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3646:x1875839944995968:12345-0@lo:400:kworker.0 Request processed in 30us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038428:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788940923.038438:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940923.038645:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944996480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038676:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0967b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839944996480:12345-0@lo:400:kworker.0 Request processed in 233us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038681:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788940923.038693:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940923.038698:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944996352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038737:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3646:x1875839944996352:12345-0@lo:400:kworker.0 Request processed in 39us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940923.038744:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788940923.038795:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944995328:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038807:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944995840:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038824:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3646:1875839944996352:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038834:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944995456:0@lo:400:kworker.0 00000100:00100000:1.0:1788940923.038844:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839944995968:0@lo:400:kworker.0 00010000:00080000:1.0:1788940923.038855:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100000 x1875839944996480/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940939 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940923.038865:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839944996480:0@lo:400:kworker.0 00000100:00100000:3.0:1788940923.040806:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940923.040872:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788940923.040878:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940923.040882:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788940923.040885:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788940923.040926:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944995072:0@lo:400:kworker.0 00000100:00100000:0.0:1788940923.041099:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996608 00000100:00100000:0.0:1788940923.041107:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996608 00000100:00100000:0.0:1788940923.041160:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788940923.041169:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944996608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940923.041189:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788940923.041240:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944996608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940923.041246:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788940923.041351:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944996608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788940923.803723:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940924.070073:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788940924.070096:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944996736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788940924.070167:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940924.070290:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996736 00000100:00100000:0.0:1788940924.070299:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996736 00000100:00100000:0.0:1788940924.070355:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788940924.070364:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944996736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788940924.070392:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940924.070458:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944996736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940924.070482:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788940924.070544:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944996736:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788940924.828282:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940925.279209:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940925.279347:0:17154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832832 00000100:00100000:0.0:1788940925.279358:0:17154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832832 00000100:00100000:0.0:1788940925.279450:0:17154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1788940925.279462:0:17154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+13:16408:x1875839921832832:12345-192.168.202.25@tcp:35:umount.0 00000100:00080000:3.0:1788940925.279469:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788940925.279761:0:17154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000100:00100000:0.0:1788940925.279893:0:17154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:16408:x1875839921832832:12345-192.168.202.25@tcp:35:umount.0 Request processed in 433us (693us total) trans 8589934625 rc 0/0 00000100:00100000:0.0:1788940925.279901:0:17154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000020:00080000:0.0:1788940925.279906:0:17154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788940925.284484:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940925.284531:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940925.285014:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921833088 00000100:00100000:0.0:1788940925.285046:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921833088 00000100:00100000:0.0:1788940925.285112:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921832960 00000100:00100000:0.0:1788940925.285116:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921832960 00000100:00100000:0.0:1788940925.285147:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1788940925.285158:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+14:2407:x1875839921833088:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940925.285175:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940925.285195:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6000/0x9c34acc08bade75f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7649 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940925.285212:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940925.285312:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+13:2407:x1875839921833088:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 156us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940925.285330:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1788940925.285351:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:0.0:1788940925.285368:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03773a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:2407:x1875839921832960:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940925.285393:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940925.285402:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6400/0x9c34acc08bade758 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7618 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940925.285412:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940925.285431:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03773a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:2407:x1875839921832960:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 73us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940925.285438:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1788940925.286897:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788940925.287123:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921833216 00000100:00100000:0.0:1788940925.287131:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921833216 00000100:00100000:0.0:1788940925.287766:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:0.0:1788940925.287779:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:2407:x1875839921833216:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940925.287795:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940925.287825:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035936e00/0x9c34acc08bade81c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76ff expref: 11 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940925.287843:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940925.287905:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:2407:x1875839921833216:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 129us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940925.287913:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1788940925.291775:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940925.291875:0:18670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921833344 00000100:00100000:3.0:1788940925.291899:0:18670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921833344 00000100:00080000:0.0:1788940925.292143:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788940925.292212:0:18670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:3.0:1788940925.292228:0:18670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2403:x1875839921833344:12345-192.168.202.25@tcp:9:umount.0 00000020:00000080:3.0:1788940925.292322:0:18670:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade77b 00000100:00080000:3.0:1788940925.292335:0:18670:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940925.292407:0:18670:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788940925.292618:0:18670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+2:2403:x1875839921833344:12345-192.168.202.25@tcp:9:umount.0 Request processed in 393us (858us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940925.292629:0:18670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00010000:00010000:1.0:1788940925.292745:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940925.304448:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940925.304638:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834240 00000100:00100000:1.0:1788940925.304654:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834240 00000100:00100000:1.0:1788940925.304753:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:1.0:1788940925.304769:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+15:2403:x1875839921834240:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:1.0:1788940925.304817:0:17152:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade76d 00000020:00010000:1.0:1788940925.304842:0:17152:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf07e0b000: total 0 00000100:00080000:1.0:1788940925.304847:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940925.304884:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934625 00000100:00100000:1.0:1788940925.305122:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6124d7c-7da2-46c0-b57e-23d795ef33aa+14:2403:x1875839921834240:12345-192.168.202.25@tcp:39:umount.0 Request processed in 356us (686us total) trans 8589934626 rc 0/0 00000100:00100000:1.0:1788940925.305131:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000020:00010000:3.0:1788940925.306237:0:17139:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf07e0b000: total 0 00010000:00010000:3.0:1788940925.306246:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940925.306358:0:17139:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf07e0b000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788940925.306401:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940925.306406:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788940925.306417:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219e00/0x9c34acc08bade9c7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7784 expref: 13 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306441:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940925.306444:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788940925.306448:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c000/0x9c34acc08bade996 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc776f expref: 12 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306483:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d00293a900) 00010000:00010000:3.0:1788940925.306486:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940925.306490:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936a00/0x9c34acc08badea84 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77bc expref: 11 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306513:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d0207afe00) 00010000:00010000:3.0:1788940925.306516:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788940925.306520:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035937200/0x9c34acc08bade854 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc770d expref: 10 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306539:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:3.0:1788940925.306541:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940925.306545:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08bade893 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc771b expref: 9 pid: 17152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306560:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d02e967100) 00010000:00010000:3.0:1788940925.306562:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788940925.306566:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c600/0x9c34acc08badea22 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7799 expref: 8 pid: 17151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306595:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d0207afa00) 00010000:00010000:3.0:1788940925.306600:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788940925.306604:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d035936600/0x9c34acc08bade838 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7706 expref: 7 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306620:0:17139:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91cf06dfcd00) 00010000:00010000:3.0:1788940925.306622:0:17139:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788940925.306635:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602000/0x9c34acc08bade918 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7745 expref: 6 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940925.306652:0:17139:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf07e0b000, canceled 8 locks, left on hash table 0. 00010000:00010000:3.0:1788940925.306664:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940925.306666:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940925.306668:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940925.318596:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940925.318711:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834368 00000100:00100000:1.0:1788940925.318729:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834368 00000100:00100000:1.0:1788940925.318837:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:1.0:1788940925.318850:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+5:2403:x1875839921834368:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:1.0:1788940925.318897:0:18958:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade774 00000100:00080000:1.0:1788940925.318919:0:18958:0:(import.c:65:import_set_state_nolock()) ffff91d017cd1000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788940925.318959:0:18958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:3.0:1788940925.319356:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940925.319537:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788940925.319759:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6124d7c-7da2-46c0-b57e-23d795ef33aa+3:2403:x1875839921834368:12345-192.168.202.25@tcp:39:umount.0 Request processed in 906us (1183us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788940925.319784:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00000040:00080000:2.0:1788940925.403566:0:17184:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788940925.403593:0:17184:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788940925.403621:0:17184:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788940925.403633:0:17184:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:1.0:1788940925.852613:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940926.107801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944996864:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940926.107914:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940926.108537:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944996992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940926.108596:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940926.108777:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996992 00000100:00100000:1.0:1788940926.108789:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996992 00000100:00100000:1.0:1788940926.108859:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940926.108871:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944996992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788940926.108920:0:17155:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788940926.108982:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944996992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940926.108991:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788940926.109063:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944996992:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788940926.111362:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788940926.111392:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944997120:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940926.111483:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940926.111679:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997120 00000100:00100000:2.0:1788940926.111693:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997120 00000100:00100000:2.0:1788940926.111835:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940926.111848:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944997120:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788940926.111896:0:17890:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788940926.111964:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839944997120:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940926.111973:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940926.112044:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839944997120:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788940926.112916:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944996864 00000100:00100000:0.0:1788940926.112927:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944996864 00000100:00100000:0.0:1788940926.113062:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788940926.113073:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944996864:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940926.113109:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940926.113213:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944996864:12345-0@lo:13:osp-pre-0-1.0 Request processed in 142us (5299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940926.113220:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788940926.115005:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944996864:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940926.115708:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788940926.246399:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940926.246457:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940926.246535:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940926.246649:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834752 00000100:00100000:3.0:1788940926.246663:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834752 00000100:00100000:3.0:1788940926.246764:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834624 00000100:00100000:3.0:1788940926.246768:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834624 00000100:00100000:3.0:1788940926.246802:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1788940926.246815:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921834752:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940926.246930:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2404:x1875839921834752:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 116us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940926.246939:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 95 00000100:00100000:3.0:1788940926.246960:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00100000:3.0:1788940926.246967:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2404:x1875839921834624:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788940926.247005:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2404:x1875839921834624:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 39us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940926.247024:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 96 00000100:00080000:2.0:1788940926.247120:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788940926.247125:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788940926.247229:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834496 00000100:00100000:0.0:1788940926.247236:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834496 00000100:00100000:0.0:1788940926.247313:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 174 00000100:00100000:0.0:1788940926.247322:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:2404:x1875839921834496:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788940926.247359:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cc8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:2404:x1875839921834496:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 39us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940926.247366:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 174 00010000:00010000:3.0:1788940926.878563:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940927.274204:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940927.274252:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788940927.274591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940927.291032:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835008 00000100:00100000:0.0:1788940927.291032:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921834880 00000100:00100000:1.0:1788940927.291053:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835008 00000100:00100000:0.0:1788940927.291053:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921834880 00000100:00100000:1.0:1788940927.291126:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835136 00000100:00100000:1.0:1788940927.291129:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835136 00000100:00100000:0.0:1788940927.291140:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1788940927.291152:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+12:2406:x1875839921835008:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940927.291245:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940927.291543:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052000/0x9c34acc08bade79e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76b9 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940927.291568:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940927.291829:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+11:2406:x1875839921835008:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 677us (17638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940927.291839:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:0.0:1788940927.291866:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788940927.291874:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+10:2406:x1875839921834880:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940927.291885:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940927.291896:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042053400/0x9c34acc08bade797 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7688 expref: 10 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940927.291926:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940927.291948:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+9:2406:x1875839921834880:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 75us (17695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940927.291955:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788940927.291973:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1788940927.291980:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+8:2406:x1875839921835136:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788940927.291988:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940927.291997:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c200/0x9c34acc08bade815 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc76f8 expref: 8 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940927.292019:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940927.292038:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c999e41f-3797-4c65-8d35-6b866b5f4f29+7:2406:x1875839921835136:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 58us (17447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940927.292044:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:3.0:1788940927.300779:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788940927.301041:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835392 00000100:00100000:1.0:1788940927.301055:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835392 00000100:00100000:1.0:1788940927.301138:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:1.0:1788940927.301150:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+6:2403:x1875839921835392:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:1.0:1788940927.301244:0:17152:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade7ac 00000020:00010000:1.0:1788940927.301279:0:17152:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf07e0f000: total 0 00000100:00080000:1.0:1788940927.301285:0:17152:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0a800 : changing import state from FULL to CLOSED 00000020:00010000:0.0:1788940927.301325:0:17138:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf07e0f000: total 0 00000001:00000004:1.0:1788940927.301327:0:17152:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00010000:00010000:0.0:1788940927.301404:0:17138:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf07e0f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788940927.301449:0:17138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d00293a800) 00010000:00010000:0.0:1788940927.301454:0:17138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788940927.301465:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d042053600/0x9c34acc08bade8a1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7722 expref: 5 pid: 18958 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940927.301500:0:17138:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf07e0f000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788940927.301513:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940927.301516:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940927.301518:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940927.301549:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+3:2403:x1875839921835392:12345-192.168.202.25@tcp:39:umount.0 Request processed in 399us (784us total) trans 8589934627 rc 0/0 00000100:00100000:1.0:1788940927.301558:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788940927.315720:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940927.315845:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835520 00000100:00100000:3.0:1788940927.315860:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835520 00000100:00100000:3.0:1788940927.315942:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:3.0:1788940927.315955:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+5:2403:x1875839921835520:12345-192.168.202.25@tcp:39:umount.0 00000020:00000080:3.0:1788940927.316027:0:18958:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade7b3 00000100:00080000:3.0:1788940927.316045:0:18958:0:(import.c:65:import_set_state_nolock()) ffff91cf06074000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788940927.316083:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:3.0:1788940927.316086:0:18958:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:3.0:1788940927.318066:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:50c55b2b-64be-4d2b-a01b-9a1815d64f2a+3:2403:x1875839921835520:12345-192.168.202.25@tcp:39:umount.0 Request processed in 2097us (2347us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788940927.318082:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:2.0:1788940927.374440:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788940927.374552:0:17144:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835776 00000100:00100000:3.0:1788940927.374575:0:17144:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835776 00000100:00100000:3.0:1788940927.374661:0:17144:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 175 00000100:00100000:3.0:1788940927.374674:0:17144:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+7:2403:x1875839921835776:12345-192.168.202.25@tcp:251:umount.0 00000020:00000080:3.0:1788940927.374736:0:17144:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade74a 00000020:00010000:3.0:1788940927.374747:0:17144:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91cf07e08000: total 0 00000100:00080000:3.0:1788940927.374753:0:17144:0:(import.c:65:import_set_state_nolock()) ffff91cf07e0c800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788940927.374920:0:17139:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91cf07e08000: total 0 00010000:00010000:1.0:1788940927.375031:0:17139:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91cf07e08000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788940927.375080:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6200/0x9c34acc08bade751 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7611 expref: 3 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940927.375104:0:17139:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91cf07e08000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788940927.375120:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940927.375122:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940927.375124:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940927.375436:0:17144:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035cca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c999e41f-3797-4c65-8d35-6b866b5f4f29+1:2403:x1875839921835776:12345-192.168.202.25@tcp:251:umount.0 Request processed in 763us (1011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940927.375447:0:17144:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 175 00000020:00000080:3.0:1788940927.375459:0:17144:0:(genops.c:893:class_export_put()) final put ffff91cf07e08000/c999e41f-3797-4c65-8d35-6b866b5f4f29 00000020:00000080:0.0:1788940927.375636:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e08000/c999e41f-3797-4c65-8d35-6b866b5f4f29 for MGS 00000020:00000080:0.0:1788940927.375694:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e0c800 for MGS 00010000:00010000:0.0:1788940927.900359:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940928.157117:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944997248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940928.157220:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.158128:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997248 00000100:00100000:0.0:1788940928.158142:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997248 00000100:00100000:0.0:1788940928.158223:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788940928.158238:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944997248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788940928.158301:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788940928.158400:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839944997248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (1179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.158409:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:0.0:1788940928.158573:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788940928.158599:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944997376:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.158647:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.158688:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944997888:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.158703:0:17145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997376 00000100:00100000:2.0:1788940928.158711:0:17145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997376 00000100:00100000:0.0:1788940928.158730:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.158756:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944998400:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.158758:0:17145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788940928.158772:0:17145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944997376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.158791:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940928.158821:0:17145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035ccac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3645:x1875839944997376:12345-0@lo:400:kworker.0 Request processed in 52us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940928.158829:0:17145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788940928.158842:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944997376:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.158862:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788940928.158869:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944997504:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.158893:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.158921:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944998016:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.158946:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.158967:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944998528:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.158969:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997888 00000100:00100000:2.0:1788940928.158975:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997888 00000100:00100000:0.0:1788940928.159016:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940928.159028:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997504 00000100:00100000:2.0:1788940928.159034:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997504 00000100:00100000:2.0:1788940928.159057:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940928.159067:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944997888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159091:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788940928.159106:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944997504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159123:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944997888:12345-0@lo:400:kworker.0 Request processed in 58us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940928.159132:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788940928.159156:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839944997504:12345-0@lo:400:kworker.0 Request processed in 56us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.159166:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940928.159188:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839944997504:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159200:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998400 00000100:00100000:0.0:1788940928.159206:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998400 00000100:00100000:2.0:1788940928.159208:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944997888:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159298:0:17152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998528 00000100:00100000:0.0:1788940928.159304:0:17152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998528 00000100:00100000:0.0:1788940928.159335:0:17152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788940928.159343:0:17152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944998400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159391:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940928.159393:0:17152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf079eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839944998400:12345-0@lo:400:kworker.0 Request processed in 48us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.159402:0:17152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788940928.159407:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944998528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159429:0:18668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998016 00000100:00100000:0.0:1788940928.159434:0:18668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998016 00000100:00100000:2.0:1788940928.159464:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839944998528:12345-0@lo:400:kworker.0 Request processed in 62us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.159475:0:18668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788940928.159485:0:18668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944998016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159491:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788940928.159524:0:18668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839944998016:12345-0@lo:400:kworker.0 Request processed in 42us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.159532:0:18668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788940928.159535:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839944998016:0@lo:400:kworker.0 00010000:00080000:2.0:1788940928.159555:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100380 x1875839944998528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940928.159569:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839944998528:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159569:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944997632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159589:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839944998400:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159612:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.159647:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159671:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.159690:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944998656:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159713:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997632 00000100:00100000:2.0:1788940928.159719:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997632 00000100:00100000:0.0:1788940928.159731:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940928.159752:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998144 00000100:00100000:2.0:1788940928.159756:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998144 00000100:00100000:0.0:1788940928.159757:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788940928.159768:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944997760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159783:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788940928.159793:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944997632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159801:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.159825:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944998272:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159843:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839944997632:12345-0@lo:400:kworker.0 Request processed in 50us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940928.159851:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940928.159857:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940928.159879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944998784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159882:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788940928.159893:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944998144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.159911:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940928.159939:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839944998144:12345-0@lo:400:kworker.0 Request processed in 47us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.159942:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839944997632:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.159952:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788940928.159962:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839944998144:0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.160012:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998656 00000100:00100000:0.0:1788940928.160016:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998656 00000100:00100000:0.0:1788940928.160037:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944997760 00000100:00100000:0.0:1788940928.160040:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944997760 00000100:00100000:0.0:1788940928.160052:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998272 00000100:00100000:0.0:1788940928.160055:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998272 00000100:00100000:0.0:1788940928.160064:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998784 00000100:00100000:0.0:1788940928.160066:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998784 00000100:00100000:0.0:1788940928.160080:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788940928.160086:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944998656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.160131:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839944998656:12345-0@lo:400:kworker.0 Request processed in 43us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.160136:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788940928.160149:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788940928.160154:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944997760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.160181:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839944997760:12345-0@lo:400:kworker.0 Request processed in 27us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.160196:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788940928.160210:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788940928.160215:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944998272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.160288:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839944998272:12345-0@lo:400:kworker.0 Request processed in 73us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.160296:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788940928.160309:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788940928.160317:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944998784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940928.160353:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839944998784:12345-0@lo:400:kworker.0 Request processed in 37us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940928.160359:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1788940928.160385:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788940928.160389:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788940928.160393:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788940928.160396:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788940928.160445:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839944997248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788940928.160594:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839944997760:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.160605:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839944998272:0@lo:400:kworker.0 00010000:00080000:2.0:1788940928.160617:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100000 x1875839944998784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940928.160635:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839944998784:0@lo:400:kworker.0 00000100:00100000:2.0:1788940928.160649:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839944998656:0@lo:400:kworker.0 00000100:00100000:3.0:1788940928.162664:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940928.162693:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944998912:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788940928.162934:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940928.163012:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944998912 00000100:00100000:3.0:1788940928.163022:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944998912 00000100:00100000:3.0:1788940928.163086:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940928.163097:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944998912:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940928.163127:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788940928.163181:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839944998912:12345-0@lo:13:osp-pre-1-1.0 Request processed in 85us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940928.163190:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788940928.163250:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839944998912:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788940928.925774:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940929.189380:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944999040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788940929.189460:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940929.193486:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999040 00000100:00100000:3.0:1788940929.193504:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999040 00000100:00100000:3.0:1788940929.193577:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940929.193590:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944999040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788940929.193627:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788940929.193717:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839944999040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (4256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940929.193725:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788940929.193777:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839944999040:0@lo:13:osp-pre-0-0.0 00000020:01000004:2.0:1788940929.336091:0:20735:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788940929.359007:0:20735:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788940929.359099:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.359116:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.359125:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.359132:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.359154:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940929.359159:0:20735:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788940929.359224:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940929.359228:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788940929.359235:0:20735:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940929.360343:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d035479800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788940929.362718:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944999168:0@lo:39:umount.0 00000100:00100000:1.0:1788940929.362816:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788940929.362903:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940929.362911:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.362921:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940929.362926:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.362955:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940929.362962:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940929.362968:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940929.362971:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788940929.362974:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788940929.363021:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.363027:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940929.363062:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.363068:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6000/0x9c34acc08bade30d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade314 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.363086:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940929.363088:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940929.363090:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940929.363102:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944999296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940929.363134:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940929.363178:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999296 00000100:00100000:1.0:1788940929.363185:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999296 00000100:00100000:1.0:1788940929.363233:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940929.363242:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+24:3647:x1875839944999296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940929.363276:0:17135:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940929.363297:0:17135:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7400/0x9c34acc08bade314 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade30d expref: 24 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.363309:0:17135:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940929.363343:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3647:x1875839944999296:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940929.363350:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788940929.363397:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944999296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788940929.363905:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999168 00000100:00100000:2.0:1788940929.363913:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999168 00000100:00100000:2.0:1788940929.364005:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788940929.364021:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875839944999168:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788940929.364045:0:18958:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade33e 00000100:00080000:2.0:1788940929.364053:0:18958:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788940929.364121:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3644:x1875839944999168:12345-0@lo:39:umount.0 Request processed in 101us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788940929.364128:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1788940929.364136:0:18958:0:(genops.c:893:class_export_put()) final put ffff91d02ebf7800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:1.0:1788940929.364148:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d035479800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1788940929.364164:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1788940929.364166:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839944999168:0@lo:39:umount.0 00000020:00000080:2.0:1788940929.364218:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02ebf3800 for lustre-MDT0000 00000100:00080000:2.0:1788940929.364239:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940929.364243:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788940929.364248:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788940929.368167:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.368191:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.368199:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.368207:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.368227:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940929.368233:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.368240:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368557:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940929.368566:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368574:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940929.368578:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368588:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940929.368608:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940929.368615:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940929.368617:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788940929.368654:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368661:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940929.368699:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368707:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603400/0x9c34acc08bade25e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade265 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.368725:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.368727:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.368729:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940929.368737:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788940929.368757:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944999424:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940929.368840:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.368910:0:17137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999424 00000100:00100000:0.0:1788940929.368920:0:17137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999424 00000100:00100000:0.0:1788940929.369057:0:17137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940929.369068:0:17137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3647:x1875839944999424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788940929.369084:0:17137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940929.369101:0:17137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004603800/0x9c34acc08bade265 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade25e expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.369125:0:17137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940929.369162:0:17137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3647:x1875839944999424:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.369169:0:17137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788940929.369210:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839944999424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940929.369485:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369492:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369517:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940929.369525:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369532:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369538:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369543:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.369559:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788940929.369657:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940929.369665:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369674:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940929.369677:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369685:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940929.369693:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940929.369698:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940929.369701:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788940929.369703:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788940929.369722:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369754:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940929.369774:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369781:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602c00/0x9c34acc08bade66a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade671 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369793:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940929.369797:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369803:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d042053200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940929.369806:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369812:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940929.369818:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940929.369824:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940929.369826:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940929.369828:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940929.369841:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369847:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788940929.369852:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369868:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d042053200/0x9c34acc08bade807 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade80e expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.369878:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940929.369879:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940929.369881:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940929.370066:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944999552:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940929.370105:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940929.370150:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788940929.370155:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944999680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940929.370179:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940929.370204:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999552 00000100:00100000:1.0:1788940929.370209:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999552 00000100:00100000:1.0:1788940929.370239:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999680 00000100:00100000:1.0:1788940929.370242:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999680 00000100:00100000:1.0:1788940929.370277:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788940929.370285:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d037738050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+23:3645:x1875839944999552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940929.370294:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940929.370304:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218200/0x9c34acc08bade671 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade66a expref: 23 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.370314:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788940929.370338:0:20735:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940929.370343:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d037738050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+22:3645:x1875839944999552:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (235us total) trans 0 rc 0/0 00010000:00010000:2.0:1788940929.370356:0:20735:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940929.370357:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788940929.370368:0:20735:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788940929.370395:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788940929.370401:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+21:3645:x1875839944999680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940929.370414:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788940929.370422:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f7e00/0x9c34acc08bade80e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade807 expref: 21 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940929.370430:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788940929.370452:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:3645:x1875839944999680:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1788940929.370458:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1788940929.370463:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940929.370498:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944999680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940929.370511:0:20735:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940929.370528:0:20735:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788940929.370528:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:303c4994-a6d4-4c7c-823f-eb7dad50725e:3645:1875839944999552:0@lo:103:ldlm_bl.0 10000000:01000000:2.0:1788940929.370533:0:20735:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788940929.370537:0:20735:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788940929.370570:0:20735:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788940929.370574:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788940929.370579:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940929.370584:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:2.0:1788940929.370589:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91cf08f3d800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940929.370594:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91cf08f3f800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940929.370599:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91d020aed000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940929.370604:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: ACTIVE ffff91d034751000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940929.370611:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: UNLINKED ffff91cf07e0f000 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 192.168.202.25@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:2.0:1788940929.370616:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000: UNLINKED ffff91cf07e0b000 c6124d7c-7da2-46c0-b57e-23d795ef33aa 192.168.202.25@tcp 4 (0 4 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:2.0:1788940929.370619:0:20735:0:(genops.c:1561:class_disconnect_exports()) OBD device 5 (ffff91d035a8cd88) has exports, disconnecting them 00000020:00080000:2.0:1788940929.370622:0:20735:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91cf08f3d800), last request at 1788940928 00000020:00000080:2.0:1788940929.370628:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade639 00000100:00080000:2.0:1788940929.370642:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91cf08f3e800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788940929.370685:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf08f3d800): rc 0 00000020:00000080:2.0:1788940929.370687:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08f3d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788940929.370697:0:20735:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91cf08f3f800), last request at 1788940928 00000020:00000080:2.0:1788940929.370700:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade4db 00000100:00080000:2.0:1788940929.370705:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91cf08f39800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788940929.370722:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08f3d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788940929.370757:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08f3e800 for lustre-MDT0000 00000020:00080000:2.0:1788940929.370773:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf08f3f800): rc 0 00000020:00000080:2.0:1788940929.370776:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08f3f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:2.0:1788940929.370783:0:20735:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d020aed000), last request at 1788940849 00000020:00000080:2.0:1788940929.370787:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade42c 00000100:00080000:2.0:1788940929.370791:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf6000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788940929.370799:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08f3f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788940929.370824:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08f39800 for lustre-MDT0000 00000020:00080000:2.0:1788940929.370835:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d020aed000): rc 0 00000020:00000080:2.0:1788940929.370837:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d020aed000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:2.0:1788940929.370844:0:20735:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d034751000), last request at 1788940849 00000020:00000080:2.0:1788940929.370848:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3ca 00000100:00080000:2.0:1788940929.370852:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d034753800 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788940929.370861:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d020aed000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788940929.370898:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02ebf6000 for lustre-MDT0000 00000001:00000004:2.0:1788940929.370910:0:20735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000020:00080000:2.0:1788940929.370996:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d034751000): rc 0 00000004:00000080:2.0:1788940929.371003:0:20735:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffff9d5841857ae0 00000100:00080000:2.0:1788940929.371023:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940929.371025:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788940929.371456:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940929.371462:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.371467:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940929.371470:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.371475:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788940929.371480:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940929.371483:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940929.371484:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788940929.371486:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788940929.371503:0:17138:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.371506:0:17138:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788940929.371525:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.371539:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603600/0x9c34acc08bade250 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade257 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.371549:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.371550:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.371551:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940929.371563:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788940929.371574:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944999808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788940929.371609:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.371644:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999808 00000100:00100000:0.0:1788940929.371648:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999808 00000100:00100000:0.0:1788940929.371680:0:17136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788940929.371687:0:17136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+20:3648:x1875839944999808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788940929.372357:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940929.372367:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.372476:0:17136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788940929.372491:0:17136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004602400/0x9c34acc08bade257 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade250 expref: 20 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940929.372500:0:17136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788940929.372537:0:17136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:303c4994-a6d4-4c7c-823f-eb7dad50725e+19:3648:x1875839944999808:12345-0@lo:103:ldlm_bl.0 Request processed in 851us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.372543:0:17136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788940929.372620:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0610b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839944999808:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788940929.374034:0:20735:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788940929.374063:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788940929.374208:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940929.374212:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788940929.374221:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788940929.374372:0:20735:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788940929.374383:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788940929.374404:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940929.374406:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788940929.374416:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788940929.374481:0:20735:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788940929.374491:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788940929.374533:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff91d035a8cd88) has no exports 00000100:00100000:0.0:1788940929.375826:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944999936:0@lo:39:umount.0 00000100:00100000:0.0:1788940929.375903:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.375943:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945000064:0@lo:9:umount.0 00000100:00100000:0.0:1788940929.375970:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.376005:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945000192:0@lo:9:umount.0 00000100:00100000:0.0:1788940929.376043:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940929.376144:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000064 00000100:00100000:0.0:1788940929.376151:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000064 00000100:00100000:0.0:1788940929.376189:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000192 00000100:00100000:0.0:1788940929.376191:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000192 00000100:00100000:0.0:1788940929.376208:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940929.376216:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839945000064:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788940929.376241:0:19149:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade521 00000100:00080000:0.0:1788940929.376250:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91d03473d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940929.376502:0:19149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788940929.376641:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1875839945000064:12345-0@lo:9:umount.0 Request processed in 424us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.376649:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788940929.376666:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788940929.376672:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839945000192:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788940929.376684:0:19149:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade678 00000100:00080000:0.0:1788940929.376689:0:19149:0:(import.c:65:import_set_state_nolock()) ffff91cf06071000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788940929.376763:0:19149:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788940929.376847:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3644:x1875839945000192:12345-0@lo:9:umount.0 Request processed in 175us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940929.376854:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788940929.376885:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788940929.376922:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece2000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788940929.376937:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940929.376941:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940929.376944:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945000064:0@lo:9:umount.0 00000100:00080000:0.0:1788940929.376956:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ed25000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788940929.376965:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940929.376977:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940929.377911:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839944999936 00000100:00100000:2.0:1788940929.377921:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839944999936 00000100:00100000:2.0:1788940929.377969:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788940929.377977:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3644:x1875839944999936:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788940929.378013:0:17890:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade456 00000100:00080000:2.0:1788940929.378020:0:17890:0:(import.c:65:import_set_state_nolock()) ffff91cf07a18800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788940929.378050:0:17890:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1788940929.378169:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0610b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3644:x1875839944999936:12345-0@lo:39:umount.0 Request processed in 192us (2266us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788940929.378176:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788940929.378530:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945000192:0@lo:9:umount.0 00000100:00080000:0.0:1788940929.378573:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e81000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788940929.378579:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839944999936:0@lo:39:umount.0 00010000:00010000:0.0:1788940929.378607:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940929.378629:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788940929.386867:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 5 (ffff91d035a8cd88) has no exports 00000020:00000080:2.0:1788940929.458244:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2ab 00000020:00000080:2.0:1788940929.458318:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d035a1b800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788940929.458432:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788940929.458458:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035a1b800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788940929.458493:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940929.458517:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940929.458521:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 7 (ffff91cf08448000) has no exports 00000020:00000080:3.0:1788940929.463969:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2a4 00000020:00000080:3.0:1788940929.463990:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d035a19000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940929.464051:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035a19000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940929.464124:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940929.464136:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788940929.464139:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d035a19800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788940929.464141:0:20735:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035a19800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788940929.464152:0:20735:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:0.0:1788940929.947478:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940930.720029:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788940930.720049:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:1.0:1788940930.720064:0:17882:0:(genops.c:893:class_export_put()) final put ffff91d03787c000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788940930.720082:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00080000:1.0:1788940930.720087:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:1.0:1788940930.720089:0:17882:0:(genops.c:893:class_export_put()) final put ffff91cf06076000/50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:1.0:1788940930.720094:0:17882:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000001:00080000:1.0:1788940930.720100:0:17882:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:1.0:1788940930.720102:0:17882:0:(genops.c:893:class_export_put()) final put ffff91d017cd7800/c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:2.0:1788940930.720382:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03787c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788940930.720449:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf06076000/50c55b2b-64be-4d2b-a01b-9a1815d64f2a for lustre-MDT0001 00000020:00000080:2.0:1788940930.720473:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d017cd7800/c6124d7c-7da2-46c0-b57e-23d795ef33aa for lustre-MDT0001 00000020:00000080:2.0:1788940930.720490:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07a18800 for lustre-MDT0001 00000020:00000080:2.0:1788940930.720496:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf06074000 for lustre-MDT0001 00000020:00000080:2.0:1788940930.720498:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d017cd1000 for lustre-MDT0001 00000001:00100000:2.0:1788940930.731211:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940930.731221:0:18664:0:(genops.c:893:class_export_put()) final put ffff91d03473f800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788940930.731307:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:2.0:1788940930.731311:0:18664:0:(genops.c:893:class_export_put()) final put ffff91cf07e0d800/c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:0.0:1788940930.731422:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473f800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788940930.731479:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e0d800/c6124d7c-7da2-46c0-b57e-23d795ef33aa for lustre-OST0000 00000020:00000080:0.0:1788940930.731504:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03473d000 for lustre-OST0000 00000020:00000080:0.0:1788940930.731509:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e0d000 for lustre-OST0000 00000001:00100000:3.0:1788940930.733303:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940930.733313:0:17130:0:(genops.c:893:class_export_put()) final put ffff91d034751000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1788940930.733341:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00080000:3.0:1788940930.733350:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:3.0:1788940930.733353:0:17130:0:(genops.c:893:class_export_put()) final put ffff91cf07e0f000/50c55b2b-64be-4d2b-a01b-9a1815d64f2a 00000001:00100000:3.0:1788940930.733358:0:17130:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000001:00080000:3.0:1788940930.733362:0:17130:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934626 is committed 00000020:00000080:3.0:1788940930.733370:0:17130:0:(genops.c:893:class_export_put()) final put ffff91cf07e0b000/c6124d7c-7da2-46c0-b57e-23d795ef33aa 00000020:00000080:0.0:1788940930.733433:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034751000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:0.0:1788940930.733470:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e0f000/50c55b2b-64be-4d2b-a01b-9a1815d64f2a for lustre-MDT0000 00000020:00000080:0.0:1788940930.733497:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e0b000/c6124d7c-7da2-46c0-b57e-23d795ef33aa for lustre-MDT0000 00000020:00000080:0.0:1788940930.733536:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d034753800 for lustre-MDT0000 00000020:00000080:0.0:1788940930.733542:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e0a800 for lustre-MDT0000 00000020:00000080:0.0:1788940930.733545:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e0e800 for lustre-MDT0000 00010000:00010000:0.0:1788940930.972118:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788940931.036322:0:17902:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788940931.227699:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945000320:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788940931.227786:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940931.227898:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000320 00000100:00100000:2.0:1788940931.227908:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000320 00000100:00100000:2.0:1788940931.227978:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788940931.227987:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875839945000320:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:2.0:1788940931.227994:0:17156:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788940931.228052:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3648:x1875839945000320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 64us (265us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788940931.228059:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:02020000:2.0:1788940931.228100:0:3648:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:3.0:1788940931.235714:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788940931.235748:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945000448:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788940931.235834:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940931.236197:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000448 00000100:00100000:0.0:1788940931.236206:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000448 00000100:00100000:0.0:1788940931.236291:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940931.236312:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945000448:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788940931.236346:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788940931.236397:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945000448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 98us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940931.236405:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788940931.236473:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945000448:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788940931.236639:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788940931.237723:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940931.237730:0:3648:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788940931.237844:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940931.252800:0:3648:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940931.252814:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 604 00000100:00080000:2.0:1788940931.252824:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d03474e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940931.252869:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005044a80 x1875839945000576/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940931.257519:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945000576:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788940931.257607:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940931.259045:0:17155:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000576 00000100:00100000:2.0:1788940931.259058:0:17155:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000576 00000100:00100000:2.0:1788940931.259117:0:17155:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788940931.259126:0:17155:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945000576:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:2.0:1788940931.259144:0:17155:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788940931.276153:0:17155:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945000576:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 17011us (18531us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940931.276199:0:17155:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1788940931.276475:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940931.276482:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788940931.276485:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945000576:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:3.0:1788940931.484734:0:20735:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02a00 - data ffff91d041289bd0/ffff91d0179d9400 00000020:01000000:3.0:1788940931.484901:0:20735:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d005f06c00 - data ffff91d021429a20/ffff91d03f8ce800 00000001:00000004:3.0:1788940931.498941:0:20735:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00080000:0.0:1788940931.556744:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788940931.556755:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940931.556774:0:20735:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff91d005045500 x1875839944999936/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788940939 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940931.556802:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788940931.558393:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940931.558399:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:3.0:1788940931.558410:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940931.558425:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788940931.560139:0:17174:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788940931.560145:0:17174:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:2.0:1788940931.560158:0:17174:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:3.0:1788940931.560748:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788940931.560753:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788940931.560775:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940931.560778:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788940931.561189:0:17176:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788940931.561193:0:17176:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:2.0:1788940931.561201:0:17176:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:3.0:1788940931.562773:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade273 00000020:00000080:3.0:1788940931.562785:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08d45800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788940931.563033:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08d45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940931.565221:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade288 00000020:00000080:2.0:1788940931.565237:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08ce3800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788940931.565290:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788940931.565301:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940931.565309:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940931.565314:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 4 (ffff91d035a88000) has no exports 00000020:00000080:3.0:1788940931.565418:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08ce3800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1788940931.565655:0:20735:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788940931.565663:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2ea 00000020:00000080:2.0:1788940931.565668:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03547d800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788940931.565725:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788940931.565729:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940931.565742:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940931.565749:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 10 (ffff91cf06cd8000) has no exports 00000020:00000080:2.0:1788940931.565756:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2e3 00000020:00000080:2.0:1788940931.565761:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03ed23800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940931.565972:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03547d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788940931.566653:0:20735:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788940931.566658:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940931.566662:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:2.0:1788940931.566669:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940931.566672:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940931.566771:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ed23800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940931.566846:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940931.566855:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788940931.566862:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2d5 00000020:00000080:2.0:1788940931.566878:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03ece6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940931.566896:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03ed25000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788940931.566902:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d03ece5800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940931.566905:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece5800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788940931.566910:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788940931.567274:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788940931.567279:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940931.567285:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940931.567289:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 9 (ffff91cf0844cd88) has no exports 00000020:00000080:2.0:1788940931.567295:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2ce 00000020:00000080:2.0:1788940931.567299:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03ece7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940931.567330:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:2.0:1788940931.567737:0:20735:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788940931.567740:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940931.567743:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:2.0:1788940931.567748:0:20735:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788940931.567750:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940931.567821:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788940931.567867:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940931.567872:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:2.0:1788940931.567885:0:20735:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1788940931.567890:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2c0 00000020:00000080:2.0:1788940931.567894:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03ece1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788940931.567898:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:2.0:1788940931.567902:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940931.567905:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788940931.567907:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 8 (ffff91cf07a019d8) has no exports 00000020:00000080:2.0:1788940931.567911:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade2b9 00000020:00000080:2.0:1788940931.567914:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d005e89800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788940931.568238:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03ece2000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788940931.568244:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d03ece7000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940931.568246:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece7000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1788940931.568250:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940931.568328:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03ece1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788940931.568333:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e89800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788940931.569343:0:20735:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:3.0:1788940931.569348:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788940931.569352:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788940931.569359:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940931.569401:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940931.569409:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940931.569450:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940931.569453:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788940931.569457:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08d46800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788940931.569460:0:20735:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08d46800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788940931.569466:0:20735:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940931.569601:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d005e81000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788940931.569611:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d005e8a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940931.569613:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e8a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:0.0:1788940931.569618:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788940931.569798:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade28f 00000020:00000080:0.0:1788940931.569805:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03593b000/lustre-MDD0000_UUID 00000020:01000000:0.0:1788940931.569817:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788940931.569821:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940931.569825:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940931.569829:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 6 (ffff91d035a899d8) has no exports 00000020:00000080:0.0:1788940931.569854:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940931.569860:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1788940931.569865:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade296 00000020:00000080:0.0:1788940931.569869:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d03593d800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788940931.569877:0:20735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08ce7800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788940931.569881:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08ce7800 3 00000020:01000004:0.0:1788940931.569884:0:20735:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91cf08ce7800 from lustre-MDT0000 00000020:00000080:0.0:1788940931.569909:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940931.569912:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788940931.569915:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08d44800/lustre-MDT0000_UUID 00000020:00000080:0.0:1788940931.569917:0:20735:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08d44800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788940931.569924:0:20735:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788940931.569968:0:20735:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788940931.569972:0:20735:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788940931.569975:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788940931.569978:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940931.569980:0:20735:0:(obd_config.c:1048:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940931.569987:0:20735:0:(genops.c:1827:print_export_data()) MGS: ACTIVE ffff91d005e83000 303c4994-a6d4-4c7c-823f-eb7dad50725e 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940931.569992:0:20735:0:(genops.c:1561:class_disconnect_exports()) OBD device 1 (ffff91cf07a033b0) has exports, disconnecting them 00000020:00080000:0.0:1788940931.569996:0:20735:0:(genops.c:1536:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91d005e83000), last request at 1788940832 00000020:00000080:0.0:1788940931.570012:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade23b 00000020:00010000:0.0:1788940931.570016:0:20735:0:(genops.c:1929:obd_stale_export_put()) Put export ffff91d005e83000: total 2 00000100:00080000:0.0:1788940931.570020:0:20735:0:(import.c:65:import_set_state_nolock()) ffff91d005e84800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788940931.570033:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d005e83000): rc 0 00000020:00080000:0.0:1788940931.570037:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 1 (ffff91cf07a033b0) has no exports 00000020:00010000:0.0:1788940931.570048:0:17139:0:(genops.c:1915:obd_stale_export_get()) Get export ffff91d005e83000: total 2 00010000:00010000:0.0:1788940931.570052:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940931.570076:0:17139:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff91d005e83000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788940931.570109:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219600/0x9c34acc08bade49c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade495 expref: 14 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570126:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004602e00/0x9c34acc08bade5fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade5f3 expref: 13 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570139:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7c00/0x9c34acc08bade35a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade353 expref: 12 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570167:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f6800/0x9c34acc08bade7e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade7dd expref: 11 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570187:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219000/0x9c34acc08bade4c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade4bf expref: 10 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570197:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0027f7800/0x9c34acc08bade7f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade7eb expref: 9 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570208:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218c00/0x9c34acc08bade417 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade410 expref: 8 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570218:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7000/0x9c34acc08bade368 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade361 expref: 7 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570229:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d042052a00/0x9c34acc08bade800 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade7f9 expref: 6 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570240:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d400/0x9c34acc08bade376 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade36f expref: 5 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570250:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d0355e7200/0x9c34acc08bade624 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade61d expref: 4 pid: 17143 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570296:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d004603e00/0x9c34acc08bade249 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade242 expref: 3 pid: 17144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570308:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001218e00/0x9c34acc08bade663 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x9c34acc08bade65c expref: 2 pid: 17145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940931.570319:0:17139:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff91d005e83000, canceled 13 locks, left on hash table 0. 00000020:00000080:0.0:1788940931.570334:0:17139:0:(genops.c:893:class_export_put()) final put ffff91d005e83000/303c4994-a6d4-4c7c-823f-eb7dad50725e 00010000:00010000:0.0:1788940931.570341:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940931.570349:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940931.570351:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940931.570434:0:17145:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff91cf06088e00:17145] 2 exiting: rc = 0 00000100:00100000:3.0:1788940931.570750:0:17144:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff91d006bf2400:17144] 1 exiting: rc = 0 00000020:00000080:3.0:1788940931.570812:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03593b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1788940931.570817:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d005e80000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788940931.570819:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e80000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788940931.570822:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1788940931.570870:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03593d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788940931.570876:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e83000/303c4994-a6d4-4c7c-823f-eb7dad50725e for MGS 00000020:00000080:3.0:1788940931.570905:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d005e84800 for MGS 00000100:00100000:3.0:1788940931.571424:0:17143:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff91d02c246800:17143] 0 exiting: rc = 1 00000100:00100000:0.0:1788940931.571552:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571560:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571568:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571574:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571581:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571587:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571592:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571599:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571605:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571611:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571618:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571624:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571630:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571636:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571642:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571648:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571654:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571669:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571675:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571679:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571685:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571690:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571695:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571701:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571706:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571711:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571716:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571721:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571726:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571732:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571737:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571744:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571763:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571770:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571775:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571781:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571786:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571791:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571797:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571802:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571807:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571812:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571818:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571824:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571830:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571836:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571841:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571847:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571852:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571857:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571862:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571866:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571872:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571878:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571883:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571888:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571893:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571898:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571902:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571907:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571912:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571916:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571921:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940931.571927:0:20735:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788940931.574329:0:20735:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d005f06c80 - data ffff91d041065ca8/ffff91d03f8ccc00 00000020:01000000:0.0:1788940931.574470:0:20735:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02280 - data ffff91d0411b8288/ffff91d035d7bc00 00000020:00000080:0.0:1788940931.574953:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade21f 00000020:00000080:0.0:1788940931.574989:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08c4e000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788940931.575008:0:20735:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08ce7800 from MGS, refs=2 00000020:01000004:0.0:1788940931.575012:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08ce7800 2 00000020:01000004:0.0:1788940931.575016:0:20735:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91cf08ce7800 from MGS 00000020:00000080:0.0:1788940931.575039:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940931.575046:0:20735:0:(obd_config.c:958:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788940931.575049:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08c4b800/MGS 00000020:00000080:0.0:1788940931.575052:0:20735:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08c4b800/MGS for MGS 00000020:01000000:0.0:1788940931.575058:0:20735:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788940931.575127:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788940931.575132:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940931.575137:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940931.575145:0:20735:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91d005fc4000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940931.575150:0:20735:0:(genops.c:1561:class_disconnect_exports()) OBD device 11 (ffff91d035a8b3b0) has exports, disconnecting them 00000020:00000080:3.0:1788940931.575277:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08c4e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1788940931.576067:0:20735:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91d005fc4000), last request at 1788940833 00000020:00000080:0.0:1788940931.576073:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade322 00000020:00080000:0.0:1788940931.576087:0:20735:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d005fc4000): rc 0 00000020:00000080:0.0:1788940931.576091:0:20735:0:(genops.c:893:class_export_put()) final put ffff91d005fc4000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788940931.576435:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005fc4000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788940931.666773:0:20735:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788940931.666782:0:20735:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788940931.666787:0:20735:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940931.666794:0:20735:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940931.667041:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940931.667051:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788940931.667058:0:20735:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08ce7800 1 00000020:00000080:2.0:1788940931.667066:0:20735:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade211 00000020:00000080:2.0:1788940931.667074:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08c48000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788940931.667091:0:20735:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788940931.667097:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940931.667101:0:20735:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940931.667105:0:20735:0:(genops.c:1566:class_disconnect_exports()) OBD device 0 (ffff91cf084499d8) has no exports 00000020:00000080:3.0:1788940931.667617:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d035479800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788940931.667625:0:8:0:(genops.c:893:class_export_put()) final put ffff91d03547b800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788940931.667629:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03547b800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788940931.667640:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788940931.667722:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08c48000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788940931.773215:0:20735:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940931.773229:0:20735:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788940931.773236:0:20735:0:(genops.c:893:class_export_put()) final put ffff91cf08ce6000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788940931.773240:0:20735:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08ce6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788940931.773251:0:20735:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788940931.773414:0:20735:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91cf08ce4800 00000020:02000400:1.0:1788940931.773479:0:20735:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788940932.000055:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940933.019420:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788940933.276672:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788940933.276696:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945000704:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788940933.276765:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.276858:0:18672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000704 00000100:00100000:3.0:1788940933.276867:0:18672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000704 00000100:00100000:3.0:1788940933.276931:0:18672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788940933.276941:0:18672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945000704:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788940933.276986:0:18672:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788940933.277031:0:18672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945000704:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940933.277045:0:18672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788940933.277191:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788940933.277227:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945000704:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788940933.283276:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788940933.283283:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788940933.283286:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788940933.283294:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 686 00000100:00080000:3.0:1788940933.283300:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788940933.283306:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d03474e800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788940933.283330:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a53800 x1875839945000960/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788940933.283432:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945001088:0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.283505:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.283544:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839945001600:0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.283570:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.283595:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788940933.283601:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839945000832:0@lo:400:kworker.0 00000400:00000100:3.0:1788940933.283619:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839945000832 offset 0 length 224: 4 00000100:00100000:3.0:1788940933.283635:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945001472:0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.283656:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.283681:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945000960:0@lo:38:kworker.0 00000100:00100000:3.0:1788940933.283706:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.283739:0:19149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001088 00000100:00100000:3.0:1788940933.283750:0:19149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001088 00000100:00100000:3.0:1788940933.283813:0:19149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940933.283823:0:19149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945001088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.283885:0:19149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945001088:12345-0@lo:400:kworker.0 Request processed in 63us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940933.283892:0:19149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788940933.283914:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001600 00000100:00100000:3.0:1788940933.283930:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001600 00000100:00100000:3.0:1788940933.283967:0:17151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001472 00000100:00100000:3.0:1788940933.283970:0:17151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001472 00000100:00100000:3.0:1788940933.283992:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940933.283999:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839945001472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.284029:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839945001472:12345-0@lo:400:kworker.0 Request processed in 31us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940933.284036:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788940933.284048:0:17151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940933.284052:0:17151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875839945001600:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788940933.284057:0:17151:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788940933.284079:0:17151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3648:x1875839945001600:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940933.284085:0:17151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788940933.284113:0:17890:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945000960 00000100:00100000:3.0:1788940933.284116:0:17890:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945000960 00000100:00100000:3.0:1788940933.284134:0:17890:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940933.284138:0:17890:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875839945000960:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1788940933.284155:0:17890:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788940933.285543:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839945001344:0@lo:400:kworker.0 00000100:00100000:0.0:1788940933.285606:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940933.285643:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788940933.285650:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839945001216:0@lo:400:kworker.0 00000100:00100000:0.0:1788940933.285672:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940933.285688:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839945001728:0@lo:400:kworker.0 00000100:00100000:0.0:1788940933.285707:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788940933.285734:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001344 00000100:00100000:0.0:1788940933.285740:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001344 00000100:00100000:0.0:1788940933.285776:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001216 00000100:00100000:0.0:1788940933.285778:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001216 00000100:00100000:0.0:1788940933.285800:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001728 00000100:00100000:0.0:1788940933.285802:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001728 00000100:00100000:0.0:1788940933.285822:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940933.285828:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839945001728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788940933.285887:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3646:x1875839945001728:12345-0@lo:400:kworker.0 Request processed in 59us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788940933.285894:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788940933.285909:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940933.285913:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875839945001344:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788940933.285918:0:17150:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788940933.285939:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875839945001344:12345-0@lo:400:kworker.0 Request processed in 25us (333us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788940933.285955:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788940933.285966:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788940933.285970:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875839945001216:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788940933.285974:0:17150:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788940933.285992:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3646:x1875839945001216:12345-0@lo:400:kworker.0 Request processed in 21us (320us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788940933.285997:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788940933.286029:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788940933.286034:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d037879000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788940933.286037:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940933.288351:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788940933.288361:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788940933.296619:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91d035a51500 x1875839945001472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940933.296640:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945001472:0@lo:400:kworker.0 00000100:00100000:2.0:1788940933.296659:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945001088:0@lo:400:kworker.0 00000100:00080000:2.0:1788940933.296671:0:3648:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788940933.296676:0:3648:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788940933.296679:0:3648:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788940933.296685:0:3648:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940933.296688:0:3648:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 637 00000100:00080000:2.0:1788940933.296697:0:3648:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf08f38800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940933.296735:0:3648:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005044000 x1875839945001856/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788940933.296769:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839945001600:0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.299232:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945001856:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:2.0:1788940933.300631:0:17890:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3644:x1875839945000960:12345-0@lo:38:kworker.0 Request processed in 16484us (16918us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940933.300649:0:17890:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788940933.300888:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788940933.300958:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940933.300970:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940933.300975:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945000960:0@lo:38:kworker.0 00000100:00100000:2.0:1788940933.301503:0:17150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001856 00000100:00100000:2.0:1788940933.301522:0:17150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001856 00000100:00100000:2.0:1788940933.301565:0:17150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788940933.301572:0:17150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839945001856:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:2.0:1788940933.301594:0:17150:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788940933.301640:0:17150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839945001856:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 67us (752us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940933.301647:0:17150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:3.0:1788940933.301857:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940933.301862:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940933.301866:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945001856:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:0.0:1788940933.317754:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d037879000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940933.317766:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 604 00000100:00080000:0.0:1788940933.317777:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91d037879000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940933.318177:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a1180 x1875839945001984/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940933.318213:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3646:1875839945001216:0@lo:400:kworker.0 00010000:00080000:1.0:1788940933.318248:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61550) req@ffff91d035a51880 x1875839945001728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940933.318285:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839945001728:0@lo:400:kworker.0 00000100:00080000:1.0:1788940933.318301:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788940933.318305:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788940933.318308:0:3646:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788940933.318312:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940933.318315:0:3646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 620 00000100:00080000:1.0:1788940933.318320:0:3646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d0065a4800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940933.318449:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a3480 x1875839945002112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940933.318462:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839945001344:0@lo:400:kworker.0 00000100:00100000:3.0:1788940933.318656:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839945001984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788940933.318733:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940933.318769:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945002112:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1788940933.318790:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788940933.318937:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945001984 00000100:00100000:2.0:1788940933.318955:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945001984 00000100:00100000:2.0:1788940933.318993:0:18958:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945002112 00000100:00100000:2.0:1788940933.318996:0:18958:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945002112 00000100:00100000:2.0:1788940933.319016:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940933.319024:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875839945001984:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788940933.319046:0:18958:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788940933.319090:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875839945001984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 65us (357us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940933.319096:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788940933.319111:0:18958:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788940933.319114:0:18958:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875839945002112:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:2.0:1788940933.319122:0:18958:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788940933.319143:0:18958:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3644:x1875839945002112:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 27us (352us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788940933.319148:0:18958:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788940933.319238:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d037879000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940933.319243:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940933.319246:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839945001984:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:3.0:1788940933.319282:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788940933.319286:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788940933.319289:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945002112:0@lo:38:ptlrpcd_00_01.0 00010000:00010000:0.0:1788940934.044446:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.077159:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788940935.393395:0:20936:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788940935.405238:0:20936:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788940935.405338:0:20936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.405356:0:20936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.405366:0:20936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.405397:0:20936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.405429:0:20936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940935.405437:0:20936:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788940935.405471:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940935.405477:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788940935.405485:0:20936:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788940935.405494:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91d037879000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788940935.405499:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940935.405501:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940935.405504:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940935.406411:0:20936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406429:0:20936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406437:0:20936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406444:0:20936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406469:0:20936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788940935.406491:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788940935.406499:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406524:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584de00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940935.406529:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406539:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940935.406547:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940935.406553:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940935.406556:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788940935.406558:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788940935.406605:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406611:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940935.406650:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406658:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08bade410 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade417 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406675:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788940935.406677:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406682:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788940935.406685:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406698:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788940935.406705:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788940935.406711:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788940935.406713:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:3.0:1788940935.406726:0:17139:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406732:0:17139:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788940935.406761:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406768:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602200/0x9c34acc08bade36f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x9c34acc08bade376 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940935.406779:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940935.406781:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788940935.406783:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940935.406808:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839945002368:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788940935.406904:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940935.407003:0:17135:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945002368 00000100:00100000:3.0:1788940935.407013:0:17135:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945002368 00000100:00100000:3.0:1788940935.407064:0:17135:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788940935.407073:0:17135:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875839945002368:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788940935.407080:0:17135:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940935 with bad export cookie 11255811311682839099 00000100:00100000:1.0:1788940935.409093:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839945002240:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788940935.409184:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788940935.409291:0:17137:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788940935.409303:0:17137:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788940935.411065:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940935.411096:0:17136:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1788940935.411115:0:17136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945002240 00000100:00100000:0.0:1788940935.411130:0:17136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945002240 00000100:00100000:0.0:1788940935.422514:0:20937:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788940935.422533:0:20937:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875839945002240:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788940935.422544:0:20937:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788940935 with bad export cookie 11255811311682839099 00000100:00100000:0.0:1788940935.422657:0:20937:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3646:x1875839945002240:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (13473us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788940935.422665:0:20937:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788940935.422721:0:3646:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788940935.422727:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788940935.422731:0:3646:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.125@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1788940935.425856:0:17135:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3647:x1875839945002368:12345-0@lo:103:ldlm_bl.0 Request processed in 18771us (18941us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788940935.425874:0:17135:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788940935.425954:0:3647:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.125@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1788940935.443078:0:20936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443103:0:20936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443111:0:20936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443118:0:20936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443187:0:20936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788940935.443196:0:20936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443203:0:20936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443209:0:20936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.443215:0:20936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788940935.444074:0:3646:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.125@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788940935.444079:0:3646:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788940935.444091:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91cf08d70e00 x1875839945000832/t0(0) o400->MGC192.168.202.125@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788940949 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940935.444120:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d035a52300 x1875839945002368/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940951 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940935.444131:0:3646:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d035a50a80 x1875839945002240/t0(0) o103->MGC192.168.202.125@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788940951 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788940935.444292:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788940935.444296:0:3646:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788940935.444298:0:3646:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788940935.444400:0:3647:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91d005e87800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788940935.444431:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:303c4994-a6d4-4c7c-823f-eb7dad50725e:3647:1875839945002368:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788940935.444866:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940935.444906:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.444918:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940935.444932:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446058:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940935.446073:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940935.446081:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940935.446084:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788940935.446089:0:17138:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788940935.446111:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940935.446117:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446125:0:17138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603c00/0x9c34acc08bade65c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade663 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446151:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940935.446156:0:17138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446163:0:17138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940935.446167:0:17138:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446192:0:17138:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940935.446199:0:17138:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940935.446203:0:17138:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940935.446206:0:17138:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788940935.446212:0:17138:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940935.446215:0:17138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.446222:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.446223:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.446226:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940935.446487:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:303c4994-a6d4-4c7c-823f-eb7dad50725e:3648:1875839945000832:0@lo:400:kworker.0 00000100:00080000:0.0:1788940935.446599:0:3646:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940935.446608:0:3646:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 587 00000100:00080000:0.0:1788940935.446618:0:3646:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d005e87800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940935.446721:0:3646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a1880 x1875839945002496/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940935.446765:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:303c4994-a6d4-4c7c-823f-eb7dad50725e:3646:1875839945002240:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788940935.447084:0:20936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788940935.447095:0:20936:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08bade7f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade800 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940935.447111:0:20936:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788940935.447132:0:20936:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.447141:0:20936:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.447149:0:20936:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.447157:0:20936:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940935.447216:0:20936:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788940935.447220:0:20936:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1788940935.447225:0:20936:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1788940935.447284:0:20936:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1788940935.447289:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1788940935.447295:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940935.447303:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1788940935.447309:0:20936:0:(genops.c:1827:print_export_data()) lustre-MDT0001: ACTIVE ffff91cf07e09800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940935.447315:0:20936:0:(genops.c:1827:print_export_data()) lustre-MDT0001: ACTIVE ffff91d020fb4000 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940935.447320:0:20936:0:(genops.c:1561:class_disconnect_exports()) OBD device 14 (ffff91d017e58000) has exports, disconnecting them 00000020:00080000:2.0:1788940935.447325:0:20936:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91cf07e09800), last request at 1788940933 00000020:00000080:2.0:1788940935.447335:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade64e 00000100:00080000:2.0:1788940935.447353:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91cf07e09000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788940935.448133:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945002496:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:3.0:1788940935.448203:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839945002496 offset 0 length 520: 4 00010000:00010000:1.0:1788940935.450430:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940935.450447:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.450460:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940935.450465:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.450477:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940935.450688:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940935.450693:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940935.450695:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788940935.450698:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788940935.450714:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940935.450717:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.450722:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603200/0x9c34acc08bade361 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade368 expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940935.450740:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.450741:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.450743:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788940935.450914:0:20936:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf07e09800): rc 0 00000020:00000080:2.0:1788940935.450918:0:20936:0:(genops.c:893:class_export_put()) final put ffff91cf07e09800/lustre-MDT0001-lwp-OST0001_UUID 00010000:00010000:0.0:1788940935.451006:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940935.451049:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788940935.451169:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf07e09800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00080000:2.0:1788940935.451169:0:20936:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff91d020fb4000), last request at 1788940933 00000020:00000080:2.0:1788940935.451178:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade4f0 00000100:00080000:2.0:1788940935.451188:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91d020fb2800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788940935.451212:0:20936:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d020fb4000): rc 0 00000020:00000080:2.0:1788940935.451214:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d020fb4000/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1788940935.451223:0:20936:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffff9d58416abae0 00000020:00000080:3.0:1788940935.451245:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf07e09000 for lustre-MDT0001 00000100:00080000:2.0:1788940935.451246:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000020:00000080:3.0:1788940935.451251:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d020fb4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000100:00100000:2.0:1788940935.451274:0:20936:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff91d005046a00 x1875839945000320/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788940947 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788940935.451291:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000020:00000080:3.0:1788940935.451406:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d020fb2800 for lustre-MDT0001 00000100:00100000:3.0:1788940935.451427:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945000320:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788940935.451980:0:20936:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788940935.451986:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91d03474e800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1788940935.452199:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788940935.452203:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788940935.452232:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788940935.452320:0:20936:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788940935.452350:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788940935.452369:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788940935.452372:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1788940935.452383:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940935.452394:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945002624:0@lo:9:umount.0 00000100:00080000:2.0:1788940935.452434:0:20936:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788940935.452444:0:20936:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788940935.452493:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940935.452537:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945002752:0@lo:9:umount.0 00000100:00100000:3.0:1788940935.452560:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788940935.452610:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945002624 00000100:00100000:3.0:1788940935.452618:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945002624 00000100:00100000:3.0:1788940935.452678:0:18669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945002752 00000100:00100000:3.0:1788940935.452681:0:18669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945002752 00000100:00100000:3.0:1788940935.452704:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940935.452714:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875839945002624:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788940935.452745:0:18669:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade51a 00000100:00080000:3.0:1788940935.452767:0:18669:0:(import.c:65:import_set_state_nolock()) ffff91cf08f3b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940935.452812:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788940935.453355:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1875839945002624:12345-0@lo:9:umount.0 Request processed in 639us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940935.453365:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788940935.453386:0:18669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788940935.453394:0:18669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3644:x1875839945002752:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788940935.453409:0:18669:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade67f 00000100:00080000:3.0:1788940935.453415:0:18669:0:(import.c:65:import_set_state_nolock()) ffff91cf06077000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788940935.453445:0:18669:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788940935.454239:0:18669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3644:x1875839945002752:12345-0@lo:9:umount.0 Request processed in 842us (1673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788940935.454249:0:18669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788940935.454313:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788940935.454317:0:17146:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788940935.454400:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788940935.454474:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 14 (ffff91d017e58000) has no exports 00000100:00080000:0.0:1788940935.454633:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8ea000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788940935.454659:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940935.454662:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940935.454666:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945002752:0@lo:9:umount.0 00000100:00080000:0.0:1788940935.454683:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788940935.457290:0:3644:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788940935.457302:0:3644:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788940935.457313:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945002624:0@lo:9:umount.0 00010000:00010000:0.0:1788940935.457361:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940935.457367:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788940935.457642:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788940935.457648:0:19484:0:(genops.c:893:class_export_put()) final put ffff91cf06072800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788940935.457668:0:19484:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788940935.457669:0:19484:0:(genops.c:893:class_export_put()) final put ffff91cf06076800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788940935.457794:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf06072800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788940935.457842:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf06076800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1788940935.457863:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf06077000 for lustre-OST0001 00000020:00000080:0.0:1788940935.457868:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf06071000 for lustre-OST0001 00000020:00080000:2.0:1788940935.467163:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 14 (ffff91d017e58000) has no exports 00000020:01000000:3.0:1788940935.510936:0:20936:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035a02c00 - data ffff91d041068000/ffff91d030f93000 00000020:01000000:3.0:1788940935.511237:0:20936:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d035bae200 - data ffff91d0410a4510/ffff91d030db2000 00000001:00000004:3.0:1788940935.528545:0:20936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788940935.585120:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940935.585129:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940935.585136:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788940935.588780:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788940935.588787:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:3.0:1788940935.588804:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788940935.588807:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788940935.589245:0:17891:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788940935.589251:0:17891:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788940935.589386:0:17891:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788940935.592079:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940935.592087:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788940935.592120:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940935.592123:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788940935.593523:0:17893:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788940935.593530:0:17893:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788940935.593542:0:17893:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788940935.600636:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade384 00000020:00000080:1.0:1788940935.600649:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034756800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788940935.602131:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034756800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788940935.602460:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade399 00000020:00000080:1.0:1788940935.602471:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034756000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788940935.602588:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788940935.602596:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940935.602605:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788940935.602610:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 13 (ffff91d017e599d8) has no exports 00000004:01000000:1.0:1788940935.602857:0:20936:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788940935.603202:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3ed 00000020:00000080:1.0:1788940935.603209:0:20936:0:(genops.c:893:class_export_put()) final put ffff91cf08457800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940935.603706:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034756000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788940935.603827:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788940935.603833:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940935.603841:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940935.603846:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 18 (ffff91cf0844b3b0) has no exports 00000020:00000080:1.0:1788940935.603853:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3e6 00000020:00000080:1.0:1788940935.603858:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d02e8e9000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788940935.603996:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08457800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788940935.604003:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788940935.604605:0:20936:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788940935.604610:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788940935.604614:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788940935.604619:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940935.604621:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940935.604702:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940935.604710:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788940935.604716:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3d8 00000020:00000080:1.0:1788940935.604721:0:20936:0:(genops.c:893:class_export_put()) final put ffff91cf060e7800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940935.605423:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8ea000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788940935.605431:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d02e8d0800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940935.605434:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8d0800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788940935.605440:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788940935.605635:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788940935.605641:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940935.605646:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940935.605649:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 17 (ffff91d0050999d8) has no exports 00000020:00000080:1.0:1788940935.605656:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3d1 00000020:00000080:1.0:1788940935.605661:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d02e8d5800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788940935.606430:0:20936:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788940935.606435:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788940935.606438:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788940935.606444:0:20936:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788940935.606447:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940935.606474:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940935.606540:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788940935.606556:0:20936:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788940935.606572:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3bc 00000020:00000080:1.0:1788940935.606577:0:20936:0:(genops.c:893:class_export_put()) final put ffff91cf060e3800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788940935.606581:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788940935.606584:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940935.606588:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940935.606590:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 16 (ffff91cf06cdcd88) has no exports 00000020:00000080:1.0:1788940935.606594:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3b5 00000020:00000080:1.0:1788940935.606598:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034748800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788940935.607412:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e7800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788940935.607425:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8d5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788940935.607430:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d02e8d2800 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788940935.607436:0:15176:0:(genops.c:893:class_export_put()) final put ffff91cf060e1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940935.607438:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788940935.607443:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788940935.607586:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e3800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788940935.607592:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034748800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788940935.610505:0:20936:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788940935.610514:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940935.610519:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940935.610528:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788940935.610584:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940935.610596:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940935.610625:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940935.610628:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940935.610633:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d02ebf5800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940935.610638:0:20936:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf5800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788940935.610647:0:20936:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788940935.610816:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3a0 00000020:00000080:0.0:1788940935.610824:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034754000/lustre-MDD0001_UUID 00000020:01000000:0.0:1788940935.610840:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788940935.610844:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940935.610849:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788940935.610853:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 15 (ffff91d017e5cd88) has no exports 00000020:00000080:0.0:1788940935.610870:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940935.610873:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788940935.610877:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade3a7 00000020:00000080:0.0:1788940935.610881:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034757800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788940935.610888:0:20936:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d03547c000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788940935.610891:0:20936:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03547c000 2 00000020:01000004:0.0:1788940935.610895:0:20936:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d03547c000 from lustre-MDT0001 00000020:00000080:0.0:1788940935.610931:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940935.610936:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788940935.610938:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d034750800/lustre-MDT0001_UUID 00000020:00000080:0.0:1788940935.610940:0:20936:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034750800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788940935.610946:0:20936:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788940935.610976:0:20936:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788940935.610980:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788940935.610983:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940935.610986:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940935.610992:0:20936:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff91d02e8ed800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940935.610997:0:20936:0:(genops.c:1561:class_disconnect_exports()) OBD device 19 (ffff91d00509cd88) has exports, disconnecting them 00000020:00080000:0.0:1788940935.611002:0:20936:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff91d02e8ed800), last request at 1788940849 00000020:00000080:0.0:1788940935.611007:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade425 00000020:00080000:0.0:1788940935.611018:0:20936:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d02e8ed800): rc 0 00000020:00000080:0.0:1788940935.611022:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d02e8ed800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788940935.611478:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d03474e800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788940935.611487:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d03474a000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788940935.611489:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03474a000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788940935.611494:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788940935.611594:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034754000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788940935.611599:0:15176:0:(genops.c:893:class_export_put()) final put ffff91d034757000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788940935.611601:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034757000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788940935.611605:0:15176:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788940935.611719:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034757800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788940935.611724:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02e8ed800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:3.0:1788940935.612560:0:20936:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:3.0:1788940935.612576:0:20936:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940935.612580:0:20936:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788940935.612585:0:20936:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940935.612610:0:15176:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d037879000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788940935.612801:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940935.612809:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788940935.612812:0:20936:0:(genops.c:893:class_export_put()) final put ffff91cf060e6000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788940935.612815:0:20936:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf060e6000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788940935.612820:0:20936:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788940935.612871:0:20936:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03547c000 1 00000020:00000080:3.0:1788940935.612877:0:20936:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade34c 00000020:00000080:3.0:1788940935.612883:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d03547c800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788940935.612892:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788940935.612899:0:15176:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03547c800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788940935.612908:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940935.612933:0:20936:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940935.612936:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 12 (ffff91d00509b3b0) has no exports 00000020:00000080:0.0:1788940935.663674:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940935.663685:0:20936:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788940935.663691:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d035479000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788940935.663696:0:20936:0:(genops.c:852:class_export_destroy()) destroying export ffff91d035479000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788940935.663706:0:20936:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788940935.663823:0:20936:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91d035478000 00000020:01000000:0.0:1788940935.663840:0:20936:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788940935.663843:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940935.663846:0:20936:0:(obd_config.c:1048:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940935.663849:0:20936:0:(genops.c:1566:class_disconnect_exports()) OBD device 3 (ffff91cf07a00000) has no exports 00000100:00100000:0.0:1788940935.663933:0:17152:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff91cf07c26e00:17152] 2 exiting: rc = 0 00000100:00100000:2.0:1788940935.664091:0:18958:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff91cf07fc1200:18958] 3 exiting: rc = 0 00000100:00100000:1.0:1788940935.664237:0:17151:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff91cf06088600:17151] 1 exiting: rc = 0 00000100:00100000:1.0:1788940935.664389:0:17150:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff91cf06089e00:17150] 0 exiting: rc = 1 00000100:00100000:0.0:1788940935.664465:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664470:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664474:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664550:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664557:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664561:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664564:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664568:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664572:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664576:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664580:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664583:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664587:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664590:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664594:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664597:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664601:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664604:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664608:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664612:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664616:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664620:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664623:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664627:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664630:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664633:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664637:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664640:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664644:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664655:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664659:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664662:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664666:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664670:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664674:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664677:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664682:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664689:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664694:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664699:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664705:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664710:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664716:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664722:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664728:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664736:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664740:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664743:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664747:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664751:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664755:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664759:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664763:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664766:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664770:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664774:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664778:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664781:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664784:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664788:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664791:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664795:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664798:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.664802:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668247:0:17154:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91d02d3f3400:17154] 1 exiting: rc = 0 00000100:00100000:1.0:1788940935.668613:0:17153:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91d0050c0200:17153] 0 exiting: rc = 1 00000100:00100000:0.0:1788940935.668684:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668692:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668698:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668702:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668707:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668712:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668718:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668724:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668729:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668735:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668740:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668744:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668748:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668751:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668754:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668757:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668761:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668764:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668767:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668770:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668773:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668776:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668778:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668781:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668784:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668788:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668791:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668795:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668799:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668802:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668805:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668807:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668810:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668813:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668828:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668832:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668835:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668838:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668842:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668845:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668849:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668852:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668856:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668861:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668864:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668868:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668871:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668875:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668877:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668881:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668884:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668887:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668891:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668894:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668897:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668900:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668903:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668906:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668910:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.668915:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.669130:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.669136:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.669140:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.669144:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940935.670019:0:17155:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff91d02c1a0e00:17155] 0 exiting: rc = 1 00000100:00100000:1.0:1788940935.670141:0:17156:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff91d02c1a0c00:17156] 1 exiting: rc = 0 00000100:00100000:3.0:1788940935.670227:0:17890:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff91d00527ac00:17890] 2 exiting: rc = 0 00000100:00100000:0.0:1788940935.670646:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670655:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670662:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670669:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670676:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670694:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670701:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670707:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670721:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670728:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670734:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670742:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670766:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670773:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670780:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670787:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670793:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670800:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670806:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670812:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670820:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670828:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670835:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670841:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670862:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670870:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670877:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670884:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670892:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670898:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670904:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670910:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670917:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670939:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670944:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670950:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670971:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670981:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670988:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.670994:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671007:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671013:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671019:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671026:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671033:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671038:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671044:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671050:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671072:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671080:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671087:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671093:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671099:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671104:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671110:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671116:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671122:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671128:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671134:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671140:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671161:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671168:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671173:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.671178:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940935.680891:0:17157:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91d02c1a6200:17157] 0 exiting: rc = 1 00000100:00100000:2.0:1788940935.681058:0:17158:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91d02c1a0600:17158] 1 exiting: rc = 0 00000100:00100000:3.0:1788940935.681195:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681204:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681210:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681215:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681221:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681227:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681233:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681238:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681243:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681248:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681253:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681672:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681678:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681682:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681696:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681701:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681705:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681711:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681716:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681721:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681726:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681732:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681737:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681743:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681748:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681752:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681757:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681761:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681765:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681770:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681774:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681778:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681783:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681788:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681792:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681796:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681801:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681805:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681810:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681815:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681820:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681825:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681829:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681834:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681839:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681843:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681849:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681854:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681859:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681872:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681878:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681882:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681887:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681892:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681897:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681901:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681906:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681911:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681917:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681931:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681937:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681942:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681947:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.681952:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940935.682394:0:17160:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91d02c1a0200:17160] 1 exiting: rc = 0 00000100:00100000:0.0:1788940935.682916:0:17159:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91d031389200:17159] 0 exiting: rc = 1 00000100:00100000:3.0:1788940935.683070:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683077:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683082:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683088:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683093:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683097:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683102:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683106:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683111:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683116:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683121:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683126:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683131:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683137:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683143:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683148:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683153:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683157:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683161:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683166:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683180:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683185:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683190:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683195:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683200:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683206:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683211:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683215:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683219:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683224:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683229:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683234:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683238:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683243:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683248:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683253:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683549:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683555:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683560:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683565:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683570:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683576:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683581:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683585:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683590:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683595:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683601:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683605:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683610:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683615:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683620:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683626:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683630:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683636:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683640:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683654:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683659:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683663:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683668:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683673:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683677:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683683:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683688:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940935.683693:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684213:0:17162:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff91d0356d5800:17162] 1 exiting: rc = 0 00000100:00100000:1.0:1788940935.684734:0:17161:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff91d0356d4200:17161] 0 exiting: rc = 1 00000100:00100000:0.0:1788940935.684833:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684841:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684847:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684853:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684858:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684865:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684871:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684877:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684882:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684897:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684902:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684907:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684912:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684917:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684934:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684939:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684943:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684948:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684953:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684960:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684964:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684969:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684974:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684980:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684984:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684989:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684994:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.684999:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685003:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685008:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685013:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685019:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685024:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685030:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685034:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685040:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685045:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685050:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685055:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685061:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685066:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685072:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685076:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685082:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685094:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685099:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685103:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685108:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685113:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685117:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685122:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685126:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685131:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685135:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685140:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685144:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685149:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685153:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685158:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685162:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685167:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685171:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685175:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.685179:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940935.686055:0:17164:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff91d02d3f4000:17164] 1 exiting: rc = 0 00000100:00100000:0.0:1788940935.686346:0:17165:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff91d0200e9000:17165] 2 exiting: rc = 0 00000100:00100000:1.0:1788940935.686908:0:17163:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff91d02d3f4600:17163] 0 exiting: rc = 1 00000100:00100000:0.0:1788940935.687012:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687020:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687027:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687033:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687039:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687045:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687051:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687059:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687065:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687090:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687097:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687103:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687108:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687113:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687129:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687135:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687140:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687145:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687150:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687155:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687161:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687167:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687172:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687178:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687184:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687190:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687196:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687202:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687207:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687213:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687220:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687226:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687232:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687251:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687357:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687363:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687369:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687376:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687383:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687389:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687396:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687403:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687408:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687414:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687420:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687426:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687432:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687437:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687442:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687457:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687463:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687469:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687474:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687538:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687547:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687552:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687558:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687564:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687570:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687575:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687582:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687587:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687593:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940935.687599:0:20936:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788940935.692835:0:20936:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940935.692849:0:20936:0:(obd_config.c:958:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788940935.692856:0:20936:0:(genops.c:893:class_export_put()) final put ffff91d005e81800/MDS_uuid 00000020:00000080:1.0:1788940935.692860:0:20936:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e81800/MDS_uuid for MDS 00000020:01000000:1.0:1788940935.692865:0:20936:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788940935.693021:0:20936:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:3.0:1788940936.091774:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940937.115360:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940938.142781:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940938.395889:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940938.395908:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940938.395911:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940938.395915:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940938.395923:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940938.395932:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 688 00000100:00080000:1.0:1788940938.395939:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788940938.395947:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d0065a4800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940938.396001:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a3b80 x1875839945002880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788940938.396067:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940938.396071:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788940938.396073:0:8:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788940938.396076:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 688 00000100:00080000:1.0:1788940938.396079:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00100000:0.0:1788940938.396079:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945002880:0@lo:38:kworker.0 00000100:00080000:1.0:1788940938.396083:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf08f38800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788940938.396094:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a0380 x1875839945003136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940938.396130:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945003264:0@lo:400:kworker.0 00000400:00000100:0.0:1788940938.396132:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945002880 offset 0 length 520: 4 00000400:00000100:1.0:1788940938.396151:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003264 offset 0 length 224: 4 00000100:00100000:0.0:1788940938.396172:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945003136:0@lo:38:kworker.0 00000400:00000100:0.0:1788940938.396187:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003136 offset 0 length 520: 4 00000100:00100000:3.0:1788940938.396216:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945003008:0@lo:400:kworker.0 00000400:00000100:0.0:1788940938.396281:0:3648:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003008 offset 0 length 224: 4 00010000:00010000:2.0:1788940939.165685:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940940.187413:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788940940.192607:0:21139:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788940940.209187:0:21139:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788940940.209250:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940940.209393:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940940.209400:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940940.209427:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940940.209450:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788940940.209455:0:21139:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788940940.209485:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940940.209497:0:21139:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d03f8a3b80 x1875839945002880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940953 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940940.209513:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788940940.209549:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940940.209553:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1788940940.209558:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945002880:0@lo:38:kworker.0 00000100:00080000:0.0:1788940940.209586:0:21139:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788940940.209592:0:21139:0:(import.c:65:import_set_state_nolock()) ffff91d0065a4800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788940940.209598:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940940.209600:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940940.209603:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1788940940.210698:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788940940.210710:0:21139:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d03f8a1500 x1875839945003008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940954 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940940.210822:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788940940.210827:0:21139:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788940940.210849:0:21139:0:(import.c:65:import_set_state_nolock()) ffff91cf06329800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788940940.210919:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839945003392:0@lo:39:umount.0 00000400:00000100:1.0:1788940940.210966:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003392 offset 0 length 224: 4 00010000:00010000:2.0:1788940940.211150:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940940.211158:0:17139:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940940.211167:0:17139:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d200 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940940.211171:0:17139:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940940.211181:0:17139:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940940.211188:0:17139:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940940.211194:0:17139:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940940.211196:0:17139:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788940940.211199:0:17139:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788940940.211214:0:17139:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:2.0:1788940940.211218:0:17139:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940940.211224:0:17139:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08bade4bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade4c6 expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940940.211236:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940940.211237:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940940.211250:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940940.212741:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945003008:0@lo:400:kworker.0 00000100:00080000:2.0:1788940940.444401:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940940.444416:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940940.444420:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940940.444424:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940940.444574:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788940940.444596:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945003520:0@lo:400:kworker.0 00000400:00000100:3.0:1788940940.444655:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003520 offset 0 length 224: 4 00010000:00010000:2.0:1788940941.211675:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788940941.476721:0:18664:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788940941.476731:0:18664:0:(genops.c:893:class_export_put()) final put ffff91cf08f3a800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788940941.477952:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08f3a800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788940941.478018:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08f3b800 for lustre-OST0000 00010000:00010000:0.0:1788940942.235400:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940943.259901:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940943.451381:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940943.451393:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940943.451396:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940943.451399:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788940943.451872:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945003648:0@lo:400:kworker.0 00000400:00000100:3.0:1788940943.451930:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003648 offset 0 length 224: 4 00010000:00010000:2.0:1788940944.283478:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940945.308657:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940935/real 1788940935] req@ffff91d03f8a1880 x1875839945002496/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940945 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940945.308695:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a1880 x1875839945002496/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940945 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940945.308715:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940945.308738:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788940945.308742:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945002496:0@lo:250:ptlrpcd_00_01.0 00010000:00010000:0.0:1788940945.308804:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788940945.309747:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940945.309755:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1788940945.309759:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940945.309765:0:37:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 690 00000100:00080000:2.0:1788940945.309771:0:37:0:(import.c:630:import_select_connection()) MGC192.168.202.125@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788940945.309778:0:37:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d005e87800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940945.309812:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005044a80 x1875839945003776/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788940945.309846:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940945.309851:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788940945.309954:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788940945.309970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945003904:0@lo:400:kworker.0 00000400:00000100:1.0:1788940945.310022:0:3647:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945003904 offset 0 length 224: 4 00000100:00100000:0.0:1788940945.310185:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945003776:0@lo:250:kworker.0 00000400:00000100:0.0:1788940945.310209:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839945003776 offset 0 length 520: 4 00010000:00010000:2.0:1788940946.331719:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940947.356463:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940948.379615:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940949.403689:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940950.427399:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940940/real 1788940940] req@ffff91d03475e300 x1875839945003392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940950 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940950.427434:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03475e300 x1875839945003392/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940950 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940950.427457:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf06329800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788940950.427491:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839945003392:0@lo:39:umount.0 00000100:00080000:0.0:1788940950.427746:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788940950.427751:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788940950.427756:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788940950.428690:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428707:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428715:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428723:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428770:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788940950.428778:0:21139:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428796:0:21139:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428802:0:21139:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428809:0:21139:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940950.428822:0:21139:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788940950.428827:0:21139:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788940950.428854:0:21139:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788940950.428859:0:21139:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788940950.428864:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940950.428869:0:21139:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788940950.428873:0:21139:0:(genops.c:1566:class_disconnect_exports()) OBD device 22 (ffff91cf06cd99d8) has no exports 00000020:00080000:0.0:1788940950.428895:0:21139:0:(genops.c:1566:class_disconnect_exports()) OBD device 22 (ffff91cf06cd99d8) has no exports 00000020:01000000:0.0:1788940950.430696:0:21139:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d005f06f80 - data ffff91d021444510/ffff91d03f91bc00 00010000:00010000:2.0:1788940950.430941:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788940950.430951:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.430963:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940950.430967:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.430979:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940950.430987:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940950.430993:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788940950.430996:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788940950.430999:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788940950.431015:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:2.0:1788940950.431018:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431025:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004602a00/0x9c34acc08bade495 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade49c expref: -99 pid: 18663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431038:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788940950.431042:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431048:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788940950.431051:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431075:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788940950.431081:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788940950.431086:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788940950.431088:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788940950.431090:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788940950.431096:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:2.0:1788940950.431099:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431104:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d035936000/0x9c34acc08bade7eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade7f2 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788940950.431113:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940950.431115:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940950.431117:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940950.431192:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788940950.432546:0:21139:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d017dfd480 - data ffff91d04135d000/ffff91d030c7ac00 00010000:00010000:2.0:1788940950.437499:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1788940950.443158:0:21139:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788940950.455757:0:21139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade4aa 00000020:00000080:2.0:1788940950.455770:0:21139:0:(genops.c:893:class_export_put()) final put ffff91cf08d57800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1788940950.455799:0:21139:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf08456000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1788940950.455803:0:21139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08456000 2 00000020:01000004:2.0:1788940950.455806:0:21139:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91cf08456000 from lustre-OST0000 00000020:00000080:2.0:1788940950.455830:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940950.455840:0:21139:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1788940950.455843:0:21139:0:(genops.c:893:class_export_put()) final put ffff91cf08d53800/lustre-OST0000_UUID 00000020:00000080:2.0:1788940950.455846:0:21139:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08d53800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1788940950.455852:0:21139:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1788940950.455912:0:21139:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1788940950.455916:0:21139:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788940950.455919:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940950.455924:0:21139:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788940950.455931:0:21139:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91cf08f3c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788940950.455937:0:21139:0:(genops.c:1561:class_disconnect_exports()) OBD device 23 (ffff91cf063233b0) has exports, disconnecting them 00000020:00080000:2.0:1788940950.455942:0:21139:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91cf08f3c000), last request at 1788940865 00000020:00000080:2.0:1788940950.455946:0:21139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade4d4 00000020:00080000:2.0:1788940950.455954:0:21139:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf08f3c000): rc 0 00000020:00000080:2.0:1788940950.455959:0:21139:0:(genops.c:893:class_export_put()) final put ffff91cf08f3c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788940950.456015:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08d57800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788940950.456033:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08f3c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1788940950.459158:0:21139:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1788940950.459168:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788940950.459174:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788940950.459182:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788940950.459217:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d0065a4800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788940950.459416:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788940950.459425:0:21139:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788940950.459431:0:21139:0:(genops.c:893:class_export_put()) final put ffff91d03473d800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788940950.459436:0:21139:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473d800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788940950.459458:0:21139:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788940950.459525:0:21139:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788940950.459529:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940950.459535:0:21139:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788940950.459544:0:21139:0:(genops.c:1827:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff91cf06328000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788940950.459550:0:21139:0:(genops.c:1561:class_disconnect_exports()) OBD device 24 (ffff91cf063219d8) has exports, disconnecting them 00000020:00080000:3.0:1788940950.459556:0:21139:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff91cf06328000), last request at 1788940865 00000020:00000080:3.0:1788940950.459567:0:21139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade4e9 00000020:00080000:3.0:1788940950.459583:0:21139:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf06328000): rc 0 00000020:00000080:3.0:1788940950.459589:0:21139:0:(genops.c:893:class_export_put()) final put ffff91cf06328000/lustre-MDT0001-lwp-OST0000 00000020:00000080:3.0:1788940950.459620:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf06328000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:1.0:1788940950.468594:0:21139:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788940950.468605:0:21139:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788940950.468610:0:21139:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788940950.468619:0:21139:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788940950.468839:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940950.468848:0:21139:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:1.0:1788940950.468855:0:21139:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf08456000 1 00000020:00000080:1.0:1788940950.468862:0:21139:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade487 00000020:00000080:1.0:1788940950.468870:0:21139:0:(genops.c:893:class_export_put()) final put ffff91d03473b800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788940950.468876:0:21139:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788940950.468881:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940950.468885:0:21139:0:(obd_config.c:1048:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788940950.468889:0:21139:0:(genops.c:1566:class_disconnect_exports()) OBD device 20 (ffff91cf06cdb3b0) has no exports 00000020:00000080:1.0:1788940950.475370:0:37:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf06329800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:1.0:1788940950.475386:0:37:0:(genops.c:893:class_export_put()) final put ffff91d00d2c4000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:1.0:1788940950.475389:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d00d2c4000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:1.0:1788940950.475414:0:37:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:1.0:1788940950.475531:0:37:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788940950.610072:0:21139:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940950.610327:0:21139:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788940950.610334:0:21139:0:(genops.c:893:class_export_put()) final put ffff91cf08457000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788940950.610341:0:21139:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08457000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788940950.610357:0:21139:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788940950.610576:0:21139:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91cf08450000 00000020:02000400:1.0:1788940950.610690:0:21139:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00000100:00080000:1.0:1788940950.683645:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940950.683655:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788940950.683664:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940950.683667:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788940950.683750:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945004032:0@lo:400:kworker.0 00000400:00000100:2.0:1788940950.683818:0:3645:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945004032 offset 0 length 224: 4 00010000:00010000:3.0:1788940951.456297:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940952.483018:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940953.500656:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788940953.510487:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940938/real 1788940938] req@ffff91d03f8a0380 x1875839945003136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788940953 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788940953.510517:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a0380 x1875839945003136/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788940953 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788940953.510549:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788940953.510572:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788940953.510577:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945003136:0@lo:38:kworker.0 00000100:00080000:2.0:1788940953.511444:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940953.511452:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788940953.511455:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788940953.511458:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788940953.511461:0:8:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788940953.511468:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 693 00000100:00080000:2.0:1788940953.511484:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788940953.511491:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf08f38800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788940953.511525:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005044380 x1875839945004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788940953.516317:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839945004288:0@lo:400:kworker.0 00000400:00000100:0.0:1788940953.516387:0:3646:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945004288 offset 0 length 224: 4 00000100:00100000:0.0:1788940953.516613:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945004160:0@lo:38:kworker.0 00000400:00000100:0.0:1788940953.516635:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945004160 offset 0 length 520: 4 00000020:01000004:2.0:1788940954.374734:0:21341:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788940954.392123:0:21341:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788940954.392223:0:21341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940954.392240:0:21341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940954.392249:0:21341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940954.392548:0:21341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940954.392576:0:21341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788940954.392582:0:21341:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788940954.392612:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788940954.392796:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788940954.392803:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940954.392812:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788940954.392816:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788940954.392826:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940954.392829:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005044380 x1875839945004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940973 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:0.0:1788940954.392833:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788940954.392839:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788940954.392841:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788940954.392843:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788940954.392860:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:0.0:1788940954.392864:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788940954.392873:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00010000:00010000:0.0:1788940954.392877:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d004603a00/0x9c34acc08bade61d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade624 expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788940954.392880:0:21341:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788940954.392888:0:21341:0:(import.c:65:import_set_state_nolock()) ffff91cf08f38800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1788940954.392890:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940954.392891:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788940954.392893:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:0.0:1788940954.392893:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788940954.392898:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005044380 x1875839945004160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788940973 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.392904:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940954.392907:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 25s for inflight to error out 00000100:00100000:1.0:1788940954.392991:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945004160:0@lo:38:kworker.0 00000100:00080000:3.0:1788940954.396159:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788940954.396177:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d03f8a3800 x1875839945003264/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940954 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396205:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005044000 x1875839945003520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940956 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396215:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005045500 x1875839945003648/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940959 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396226:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005047800 x1875839945003904/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940961 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396235:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d03f8a2a00 x1875839945004032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396243:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d005047100 x1875839945004288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788940969 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788940954.396271:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788940954.396288:0:21341:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:1.0:1788940954.396374:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945004032:0@lo:400:kworker.0 00000100:00100000:1.0:1788940954.396387:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945003520:0@lo:400:kworker.0 00000100:00100000:1.0:1788940954.396394:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945003264:0@lo:400:kworker.0 00000100:00100000:1.0:1788940954.396444:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945003904:0@lo:400:kworker.0 00000100:00100000:1.0:1788940954.396451:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945003648:0@lo:400:kworker.0 00000100:00080000:3.0:1788940954.396815:0:21341:0:(import.c:65:import_set_state_nolock()) ffff91cf01631800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788940954.397047:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839945004416:0@lo:39:umount.0 00000400:00000100:1.0:1788940954.397104:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875839945004416 offset 0 length 224: 4 00000100:00100000:2.0:1788940954.397865:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3646:1875839945004288:0@lo:400:kworker.0 00010000:00010000:2.0:1788940954.526271:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940955.549147:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940956.571427:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940957.596400:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940958.619783:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788940958.875784:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788940958.875793:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788940959.644167:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940960.541982:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940945/real 1788940945] req@ffff91d005044a80 x1875839945003776/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940960 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940960.542021:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d005044a80 x1875839945003776/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788940960 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940960.542044:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788940960.542071:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1788940960.542076:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945003776:0@lo:250:kworker.0 00000100:00080000:0.0:1788940960.542220:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788940960.542225:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788940960.542228:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788940960.542232:0:8:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 700 00000100:00080000:0.0:1788940960.542238:0:8:0:(import.c:630:import_select_connection()) MGC192.168.202.125@tcp: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788940960.542244:0:8:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d005e87800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788940960.542297:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475c380 x1875839945004544/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788940960.542375:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945004544:0@lo:250:kworker.0 00000400:00000100:1.0:1788940960.542436:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875839945004544 offset 0 length 520: 4 00010000:00010000:2.0:1788940960.669527:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940961.691721:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788940962.715426:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788940963.739633:0:17138:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788940964.635468:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788940954/real 1788940954] req@ffff91d035a50380 x1875839945004416/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940964 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788940964.635501:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d035a50380 x1875839945004416/t0(0) o39->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788940964 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788940964.635519:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf01631800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788940964.635540:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839945004416:0@lo:39:umount.0 00000100:00080000:3.0:1788940964.635601:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788940964.635609:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788940964.635634:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788940964.638621:0:21341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638643:0:21341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638662:0:21341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638669:0:21341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638692:0:21341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788940964.638702:0:21341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638710:0:21341:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638717:0:21341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638725:0:21341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788940964.638752:0:21341:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1788940964.638758:0:21341:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1788940964.639132:0:21341:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1788940964.639137:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1788940964.639143:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788940964.639167:0:21341:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788940964.639171:0:21341:0:(genops.c:1566:class_disconnect_exports()) OBD device 26 (ffff91d0050e0000) has no exports 00000020:00080000:3.0:1788940964.639195:0:21341:0:(genops.c:1566:class_disconnect_exports()) OBD device 26 (ffff91d0050e0000) has no exports 00010000:00010000:1.0:1788940964.640352:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788940964.640365:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640376:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0355e6c00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940964.640381:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640393:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940964.640401:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940964.640407:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940964.640410:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1788940964.640412:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1788940964.640429:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940964.640434:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640456:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d0355e6c00/0x9c34acc08bade5f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade5fa expref: -99 pid: 19483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640471:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788940964.640475:0:18693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640481:0:18693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788940964.640484:0:18693:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640491:0:18693:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940964.640497:0:18693:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940964.640501:0:18693:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788940964.640504:0:18693:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788940964.640506:0:18693:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1788940964.640510:0:18693:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940964.640513:0:18693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640519:0:18693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d035937400/0x9c34acc08bade7dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade7e4 expref: -99 pid: 17147 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.640532:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940964.640533:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788940964.640540:0:18693:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788940964.643130:0:21341:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d017dfdb00 - data ffff91d04105c438/ffff91d030da3c00 00000020:01000000:3.0:1788940964.643385:0:21341:0:(lprocfs_status_server.c:371:lprocfs_free_client_stats()) stat ffff91d020176080 - data ffff91d04114baf8/ffff91cf079c0800 00010000:00010000:2.0:1788940964.643777:0:17139:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:3.0:1788940964.658537:0:21341:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788940964.672317:0:21341:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade608 00000020:00000080:1.0:1788940964.672330:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d02ebf0000/lustre-OST0001-osd_UUID 00000020:01000004:1.0:1788940964.672341:0:21341:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf0632d000 from lustre-OST0001, refs=2 00000020:01000004:1.0:1788940964.672345:0:21341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf0632d000 2 00000020:01000004:1.0:1788940964.672348:0:21341:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91cf0632d000 from lustre-OST0001 00000020:00000080:1.0:1788940964.672372:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940964.672372:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788940964.672382:0:21341:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:1.0:1788940964.672387:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d02ebf4800/lustre-OST0001_UUID 00000020:00000080:1.0:1788940964.672390:0:21341:0:(genops.c:852:class_export_destroy()) destroying export ffff91d02ebf4800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:1.0:1788940964.672399:0:21341:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:1.0:1788940964.672487:0:21341:0:(pinger.c:399:ptlrpc_pinger_del_import()) removing pingable import 303c4994-a6d4-4c7c-823f-eb7dad50725e->MGS 00010000:00010000:1.0:1788940964.672501:0:21341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940964.672510:0:21341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940964.672515:0:21341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:1.0:1788940964.672517:0:21341:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:1.0:1788940964.672520:0:21341:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:1.0:1788940964.672532:0:21341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940964.672538:0:21341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d001219800/0x9c34acc08bade353 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade35a expref: -99 pid: 17881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788940964.672549:0:21341:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788940964.672554:0:21341:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788940964.672557:0:21341:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788940964.672568:0:21341:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:1.0:1788940964.672569:0:21341:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:1.0:1788940964.672578:0:21341:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d005e87800 00010000:00010000:1.0:1788940964.672581:0:21341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08bade242 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x9c34acc08bade249 expref: -99 pid: 17129 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788940964.672598:0:21341:0:(import.c:65:import_set_state_nolock()) ffff91d005e87800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:1.0:1788940964.672602:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1788940964.672604:0:21341:0:(pinger.c:194:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1788940964.672606:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1788940964.672609:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1788940964.672621:0:21341:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d03475c380 x1875839945004544/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788940980 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1788940964.672694:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940964.672698:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:0.0:1788940964.672745:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:303c4994-a6d4-4c7c-823f-eb7dad50725e:3644:1875839945004544:0@lo:250:kworker.0 10000000:01000000:1.0:1788940964.672805:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940964.672813:0:21341:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade22d 00000020:00000080:1.0:1788940964.672819:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d005e84000/303c4994-a6d4-4c7c-823f-eb7dad50725e 00000020:01000000:1.0:1788940964.672838:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of MGC192.168.202.125@tcp (flags='') 00000020:00000080:1.0:1788940964.672843:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940964.672848:0:21341:0:(obd_config.c:1048:class_cleanup()) MGC192.168.202.125@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788940964.672857:0:21341:0:(genops.c:1566:class_disconnect_exports()) OBD device 2 (ffff91cf07a04d88) has no exports 00000020:00000080:2.0:1788940964.672890:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d005e84000/303c4994-a6d4-4c7c-823f-eb7dad50725e for MGC192.168.202.125@tcp 10000000:01000000:1.0:1788940964.672919:0:17147:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788940964.672953:0:21341:0:(obd_class.h:676:obd_cleanup_client_import()) MGC192.168.202.125@tcp: client import never connected 00000100:00080000:1.0:1788940964.672955:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788940964.672957:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788940964.672958:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788940964.672959:0:21341:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788940964.673011:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940964.673053:0:21341:0:(obd_config.c:958:class_detach()) detach on obd MGC192.168.202.125@tcp (uuid 303c4994-a6d4-4c7c-823f-eb7dad50725e) 00000020:01000000:1.0:1788940964.673059:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788940964.673062:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940964.673066:0:21341:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788940964.673076:0:21341:0:(genops.c:1827:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91cf06075800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788940964.673081:0:21341:0:(genops.c:1561:class_disconnect_exports()) OBD device 27 (ffff91d03ec5b3b0) has exports, disconnecting them 00000020:00080000:1.0:1788940964.673086:0:21341:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91cf06075800), last request at 1788940882 00000020:00000080:1.0:1788940964.673090:0:21341:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade632 00000020:00080000:1.0:1788940964.673101:0:21341:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf06075800): rc 0 00000020:00000080:1.0:1788940964.673105:0:21341:0:(genops.c:893:class_export_put()) final put ffff91cf06075800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788940964.673498:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf06075800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788940964.673847:0:21341:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788940964.673851:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788940964.673855:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788940964.673859:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940964.673926:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91d005e87800 for MGC192.168.202.125@tcp 00000020:00000080:2.0:1788940964.673931:0:8:0:(genops.c:893:class_export_put()) final put ffff91cf08c4c000/303c4994-a6d4-4c7c-823f-eb7dad50725e 00000020:00000080:2.0:1788940964.673933:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08c4c000/303c4994-a6d4-4c7c-823f-eb7dad50725e for MGC192.168.202.125@tcp 00000020:01000000:2.0:1788940964.673937:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd MGC192.168.202.125@tcp (303c4994-a6d4-4c7c-823f-eb7dad50725e) 00000020:00000080:0.0:1788940964.674378:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940964.674383:0:21341:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788940964.674387:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788940964.674395:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788940964.674397:0:21341:0:(obd_config.c:1048:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788940964.674402:0:21341:0:(genops.c:1827:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff91cf01633000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788940964.674407:0:21341:0:(genops.c:1561:class_disconnect_exports()) OBD device 28 (ffff91d03ec5cd88) has exports, disconnecting them 00000020:00080000:0.0:1788940964.674410:0:21341:0:(genops.c:1536:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff91cf01633000), last request at 1788940882 00000020:00000080:0.0:1788940964.674412:0:21341:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade647 00000020:00080000:0.0:1788940964.674427:0:21341:0:(genops.c:1541:class_disconnect_export_list()) disconnected export at 0@lo (ffff91cf01633000): rc 0 00000020:00000080:0.0:1788940964.674431:0:21341:0:(genops.c:893:class_export_put()) final put ffff91cf01633000/lustre-MDT0001-lwp-OST0001 00000020:00000080:2.0:1788940964.674531:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf08f38800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788940964.674536:0:8:0:(genops.c:893:class_export_put()) final put ffff91cf08453000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1788940964.674538:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf08453000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1788940964.674542:0:8:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940964.675378:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf01633000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:2.0:1788940964.680398:0:21341:0:(obd_class.h:676:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788940964.680479:0:21341:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788940964.680484:0:21341:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788940964.680492:0:21341:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788940964.680527:0:8:0:(genops.c:1191:obd_zombie_import_free()) destroying import ffff91cf01631800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:2.0:1788940964.680628:0:17138:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1788940964.681291:0:18693:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788940964.681579:0:17139:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788940964.682480:0:17134:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91d006bf3000:17134] 1 exiting: rc = 0 00000100:00100000:0.0:1788940964.688029:0:17133:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91d0311b0200:17133] 0 exiting: rc = 1 00000100:00100000:2.0:1788940964.688487:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.689356:0:17135:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91d006bf2000:17135] 0 exiting: rc = 1 00000100:00100000:0.0:1788940964.689957:0:17137:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91d006bf2600:17137] 2 exiting: rc = 0 00000100:00100000:0.0:1788940964.691614:0:20937:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91cf010aca00:20937] 3 exiting: rc = 0 00000100:00100000:0.0:1788940964.692017:0:17136:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91d006bf3400:17136] 1 exiting: rc = 0 00000100:00100000:2.0:1788940964.692161:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692179:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692204:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692210:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692275:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692287:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692307:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692313:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692321:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692327:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692332:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692341:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692346:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692352:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692359:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692365:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692371:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692377:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692383:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692389:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692395:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692400:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692406:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692412:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692417:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692424:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692429:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692434:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692439:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692445:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692450:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692456:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692460:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692466:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692481:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692487:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692492:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692497:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692503:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692508:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692514:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692519:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692524:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692530:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692536:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692541:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692546:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692551:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692555:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692561:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692566:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692572:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692577:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692582:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692587:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692592:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692597:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692602:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692607:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692614:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692619:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692625:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692630:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.692635:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788940964.693820:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788940964.693832:0:21341:0:(obd_config.c:958:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:2.0:1788940964.693845:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d0196c0800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:2.0:1788940964.693877:0:21341:0:(genops.c:852:class_export_destroy()) destroying export ffff91d0196c0800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:2.0:1788940964.693884:0:21341:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:2.0:1788940964.694025:0:21341:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf0632d000 1 00000020:00000080:2.0:1788940964.694032:0:21341:0:(genops.c:1476:class_disconnect()) disconnect: cookie 0x9c34acc08bade5ec 00000020:00000080:2.0:1788940964.694040:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d03473a000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1788940964.694087:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1788940964.694092:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788940964.694098:0:21341:0:(obd_config.c:1048:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788940964.694102:0:21341:0:(genops.c:1566:class_disconnect_exports()) OBD device 25 (ffff91cf06320000) has no exports 00000020:00000080:0.0:1788940964.696856:0:8:0:(genops.c:852:class_export_destroy()) destroying export ffff91d03473a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1788940964.721800:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788940964.721818:0:21341:0:(obd_config.c:958:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1788940964.721825:0:21341:0:(genops.c:893:class_export_put()) final put ffff91cf0632e800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1788940964.721830:0:21341:0:(genops.c:852:class_export_destroy()) destroying export ffff91cf0632e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1788940964.721844:0:21341:0:(genops.c:443:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1788940964.722155:0:21341:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff91cf0632d800 00000020:01000000:1.0:1788940964.722188:0:21341:0:(obd_config.c:2576:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1788940964.722193:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788940964.722197:0:21341:0:(obd_config.c:1048:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788940964.722201:0:21341:0:(genops.c:1566:class_disconnect_exports()) OBD device 21 (ffff91d005098000) has no exports 00000020:00000080:0.0:1788940964.722573:0:21341:0:(obd_config.c:1571:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788940964.722580:0:21341:0:(obd_config.c:958:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788940964.722585:0:21341:0:(genops.c:893:class_export_put()) final put ffff91d034738000/OSS_uuid 00000020:00000080:0.0:1788940964.722588:0:21341:0:(genops.c:852:class_export_destroy()) destroying export ffff91d034738000/OSS_uuid for OSS 00000020:01000000:0.0:1788940964.722595:0:21341:0:(genops.c:443:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1788940964.722747:0:18670:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff91d039730000:18670] 2 exiting: rc = 0 00000100:00100000:0.0:1788940964.722835:0:18669:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff91d039730200:18669] 1 exiting: rc = 0 00000100:00100000:1.0:1788940964.722930:0:18668:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff91d030cd9200:18668] 0 exiting: rc = 1 00000100:00080000:2.0:1788940964.722988:0:17146:0:(pinger.c:603:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788940964.723130:0:19149:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff91d02e8fbe00:19149] 3 exiting: rc = 0 00000100:00100000:0.0:1788940964.723203:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723359:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723367:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723373:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723378:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723383:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723389:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723395:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723401:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723406:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723411:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723429:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723435:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723440:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723446:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723451:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723457:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723462:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723468:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723474:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723480:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723486:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723492:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723497:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723503:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723508:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723513:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723519:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723525:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723530:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723536:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723541:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723548:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723554:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723560:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723572:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723579:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723584:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723589:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723595:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723604:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723611:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723616:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723621:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723626:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723631:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723642:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723647:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723672:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723677:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723682:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723687:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723692:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723698:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723704:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723709:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723714:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723718:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723723:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723727:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723732:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723737:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723743:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.723748:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.745074:0:18672:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91d039731800:18672] 1 exiting: rc = 0 00000100:00100000:0.0:1788940964.745184:0:18671:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91d039731a00:18671] 0 exiting: rc = 1 00000100:00100000:1.0:1788940964.746896:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746911:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746922:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746934:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746946:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746958:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746970:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746980:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.746992:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747004:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747016:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747028:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747052:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747057:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747062:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747067:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747072:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747076:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747081:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747086:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747091:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747096:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747100:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747105:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747110:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747116:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747121:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747126:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747132:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747137:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747143:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747153:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747164:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747175:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747185:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747197:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747208:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747214:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747219:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747225:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747231:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747245:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747252:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747273:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747282:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747289:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747300:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747318:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747330:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747341:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747352:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747363:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747374:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747385:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747396:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747413:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747426:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747437:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747447:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747457:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747467:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747478:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747488:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.747499:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.750364:0:18675:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91cf07a6a200:18675] 2 exiting: rc = 0 00000100:00100000:0.0:1788940964.750587:0:18674:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91cf07a6be00:18674] 1 exiting: rc = 0 00000100:00100000:0.0:1788940964.750769:0:18673:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91d039731600:18673] 0 exiting: rc = 1 00000100:00100000:1.0:1788940964.750988:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.750996:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751003:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751008:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751014:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751020:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751025:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751031:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751036:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751043:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751048:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751053:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751059:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751066:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751072:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751096:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751103:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751109:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751130:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751135:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751141:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751147:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751163:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751169:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751180:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751186:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751192:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751198:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751204:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751210:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751217:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751223:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751229:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751236:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751243:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751248:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751254:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751278:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751286:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751309:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751318:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751491:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751502:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751509:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751515:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751522:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751529:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751536:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.751541:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752350:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752359:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752364:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752370:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752387:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752391:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752407:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752414:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752420:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752427:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752434:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752439:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752445:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752453:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788940964.752459:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.760601:0:18676:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91cf07a6b000:18676] 0 exiting: rc = 1 00000100:00100000:1.0:1788940964.760737:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91cf07a6a000:18677] 1 exiting: rc = 0 00000100:00100000:0.0:1788940964.760829:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760837:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760841:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760846:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760851:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760856:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760861:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760866:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760871:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760876:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760880:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760885:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760903:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760910:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760915:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760920:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760925:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760931:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760937:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760941:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760946:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760951:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760957:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760962:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.760967:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761080:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761088:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761093:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761098:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761104:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761108:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761113:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761118:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761123:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761128:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761133:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761138:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761143:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761148:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761154:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761159:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761165:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761170:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761175:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761180:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761682:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761688:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761704:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761710:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761715:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761719:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761724:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761729:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761891:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761900:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761904:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761909:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761914:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761919:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761924:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761930:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761936:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761941:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788940964.761947:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788940964.764747:0:18678:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91d030d82400:18678] 0 exiting: rc = 1 00000100:00100000:3.0:1788940964.764853:0:18679:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91d030d82200:18679] 1 exiting: rc = 0 00000100:00100000:2.0:1788940964.764923:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764963:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764971:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764978:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764984:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764991:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.764997:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765003:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765009:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765015:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765024:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765031:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765038:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765135:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765145:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765151:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765169:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765175:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765181:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765187:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765193:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765199:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765205:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765219:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765226:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765277:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765287:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765294:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765301:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765308:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765314:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765319:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765324:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765330:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765335:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765340:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765345:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765363:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765370:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765377:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765383:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765389:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765395:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765401:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765410:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765418:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765426:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765434:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765441:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765462:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765470:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765476:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765482:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765489:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765494:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765500:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765506:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765515:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765522:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765529:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765542:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765551:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765558:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788940964.765573:0:21341:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788940964.775472:0:21341:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788940988.712723:0:22107:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788941001.350739:0:22706:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788941001.350748:0:22706:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788941001.350750:0:22706:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788941001.354518:0:22706:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d0065f9800 00000020:01000004:2.0:1788941001.354542:0:22706:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788941001.354551:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788941001.354570:0:22706:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91cf06324d88) 00000020:00000080:2.0:1788941001.354585:0:22706:0:(obd_config.c:786:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788941001.485828:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788941001.487067:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.494303:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.496236:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.496488:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.496662:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.498013:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.498950:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.499243:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.499451:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.499738:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.500029:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.500335:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.500526:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.500690:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.500852:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.501053:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.501304:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.501475:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.501641:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.501803:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.501968:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.502126:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.502521:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.502720:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.502927:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.503141:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.503387:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.503604:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.503821:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.504052:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.504284:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.504567:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788941001.504776:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.504993:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788941001.505751:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.505970:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.507664:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.507980:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.508201:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.508437:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.508650:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.508885:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.509097:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.509305:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.509530:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.509951:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788941001.511115:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.511566:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.512407:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.513019:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.514201:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:2.0:1788941001.514559:0:22706:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00080000:01000000:2.0:1788941001.515140:0:22706:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788941001.516936:0:22706:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788941001.516948:0:22706:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788941001.516967:0:22706:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeaa0 00000020:01000004:2.0:1788941001.516976:0:22706:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:2.0:1788941001.516982:0:22706:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788941001.516989:0:22706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d0065f9800 from MGS 00000020:01000004:2.0:1788941001.516993:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788941001.517009:0:22706:0:(genops.c:415:class_newdev()) Allocate new device MGS (ffff91cf06320000) 00000020:00000080:2.0:1788941001.517022:0:22706:0:(obd_config.c:786:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788941001.517094:0:22706:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d0065f9800 from MGS, refs=2 00080000:01000000:2.0:1788941001.517098:0:22706:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788941001.517103:0:22706:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeaae 00000100:00100000:2.0:1788941001.517239:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788941001.517418:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788941001.517425:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788941001.518996:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788941001.519056:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788941001.521488:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941001.522514:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788941001.522524:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788941001.523409:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788941001.523422:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788941001.528608:0:22706:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788941001.528629:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788941001.530289:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941001.530296:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941001.530297:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941001.530690:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941001.530692:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941001.530694:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941001.531563:0:22706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788941001.538962:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788941001.541871:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788941001.544999:0:22718:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788941001.545065:0:22706:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788941001.545111:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788941001.546975:0:22706:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788941001.548093:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.548544:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788941001.548554:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788941001.556038:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788941001.556053:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788941001.556521:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788941001.556529:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788941001.557361:0:22706:0:(obd_config.c:900:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788941001.557387:0:22706:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.125@tcp' 00000020:01000004:3.0:1788941001.557389:0:22706:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788941001.557425:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.125@tcp (typ=mgc) 00000020:00000080:3.0:1788941001.557442:0:22706:0:(genops.c:415:class_newdev()) Allocate new device MGC192.168.202.125@tcp (ffff91d03ec599d8) 00000020:00000080:3.0:1788941001.557463:0:22706:0:(obd_config.c:786:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788941001.557563:0:22706:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03faea000@MGC192.168.202.125@tcp: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788941001.557743:0:22706:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.125@tcp-0 is initialized 00000040:01000000:3.0:1788941001.557756:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 1 is initialized 00000100:00080000:2.0:1788941001.559015:0:22723:0:(pinger.c:501:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788941001.579550:0:22724:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788941001.579688:0:22706:0:(obd_config.c:900:class_setup()) finished setup of obd MGC192.168.202.125@tcp (uuid 66773969-0b9c-4025-866a-db20e971736d) 00000020:00000080:3.0:1788941001.579723:0:22706:0:(genops.c:1393:class_connect()) connect: client 66773969-0b9c-4025-866a-db20e971736d, cookie 0x9c34acc08badeabc 00000100:00080000:3.0:1788941001.579741:0:22706:0:(import.c:545:import_select_connection()) MGC192.168.202.125@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941001.579749:0:22706:0:(import.c:665:import_select_connection()) MGC192.168.202.125@tcp: import ffff91d03faea000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941001.579923:0:22706:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a51c00 x1875839945004672/t0(0) o250->MGC192.168.202.125@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941001.580031:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66773969-0b9c-4025-866a-db20e971736d:3644:1875839945004672:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788941001.580118:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788941001.580201:0:22706:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import 66773969-0b9c-4025-866a-db20e971736d->MGS 00000020:01000004:3.0:1788941001.580226:0:22706:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788941001.580233:0:22706:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788941001.580250:0:22706:0:(genops.c:415:class_newdev()) Allocate new device MDS (ffff91d03ec58000) 00000020:00000080:3.0:1788941001.580296:0:22706:0:(obd_config.c:786:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788941001.580660:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945004672 00000100:00100000:1.0:1788941001.580669:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945004672 00000100:00100000:1.0:1788941001.580715:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941001.580724:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3644:x1875839945004672:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788941001.580749:0:22719:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 66773969-0b9c-4025-866a-db20e971736d@0@lo t0 exp 0000000000000000 cur 756 last 0 00000020:00000080:1.0:1788941001.580783:0:22719:0:(genops.c:1393:class_connect()) connect: client 66773969-0b9c-4025-866a-db20e971736d, cookie 0x9c34acc08badeaca 00000100:00080000:1.0:1788941001.580936:0:22719:0:(import.c:65:import_set_state_nolock()) ffff91d02ebf3800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941001.585552:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+5:3644:x1875839945004672:12345-0@lo:250:mount.lustre.0 Request processed in 4813us (5419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941001.585572:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788941001.585750:0:3644:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.202.125@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788941001.585926:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.202.125@tcp: connect to target with instance 0 00000100:00080000:0.0:1788941001.585939:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.202.125@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788941001.585946:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788941001.585953:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03faea000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788941001.585957:0:3644:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788941001.585980:0:3644:0:(pinger.c:187:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788941001.585988:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:66773969-0b9c-4025-866a-db20e971736d:3644:1875839945004672:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788941001.616699:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.617492:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788941001.617500:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788941001.622969:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788941001.622996:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788941001.631238:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788941001.631293:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788941001.635915:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.636159:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788941001.636166:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788941001.636950:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788941001.636959:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788941001.720454:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.722553:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788941001.722563:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788941001.727657:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788941001.727674:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1788941001.734670:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.736217:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788941001.736226:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788941001.737861:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788941001.737874:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788941001.742213:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941001.742444:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788941001.742450:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788941001.744131:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788941001.744141:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788941001.744717:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941001.744891:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788941001.744896:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788941001.748473:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788941001.748490:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788941001.794739:0:22706:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941001.797043:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788941001.797058:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788941001.800177:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788941001.800193:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788941001.801614:0:22706:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788941001.801626:0:22706:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788941001.803869:0:22706:0:(obd_config.c:900:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788941001.803905:0:22706:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788941001.803912:0:22706:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788941001.804322:0:22706:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788941001.804359:0:22706:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788941001.804364:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788941001.804365:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788941001.804366:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941001.804367:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941001.804368:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941001.804370:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941001.804371:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941001.804372:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788941001.804374:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941001.804376:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788941001.804378:0:22706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788941001.804380:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788941001.804382:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788941001.804383:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941001.804384:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941001.804385:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941001.804390:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941001.804391:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788941001.804392:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788941001.804393:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941001.804394:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788941001.804430:0:22706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788941001.804451:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945004800:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788941001.804521:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941001.804563:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788941001.804643:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945004800 00000100:00100000:3.0:1788941001.804650:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945004800 00000100:00100000:3.0:1788941001.804716:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941001.804727:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+5:22706:x1875839945004800:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788941001.804774:0:22722:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788941001.804777:0:22722:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788941001.804781:0:22722:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:1.0:1788941001.805446:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788941001.806608:0:22722:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:0.0:1788941001.810014:0:22744:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1788941001.810126:0:22744:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:0.0:1788941001.810130:0:22744:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1788941001.810132:0:22744:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1788941001.810507:0:22744:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:0.0:1788941001.814741:0:22722:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788941001.814753:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788941001.820117:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+5:22706:x1875839945004800:12345-0@lo:253:mount.lustre.0 Request processed in 15375us (15580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941001.820146:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941001.820380:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945004800:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941001.820402:0:22706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788941001.820407:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941001.820409:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788941001.820410:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941001.820412:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941001.820414:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941001.820433:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941001.820436:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788941001.820437:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788941001.820439:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941001.820441:0:22706:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941001.820466:0:22706:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d0065f9800 from lustre-MDT0000 10000000:01000000:3.0:1788941001.820523:0:22706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788941001.820527:0:22706:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788941001.820533:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91d03ec599d8 10000000:01000000:3.0:1788941001.820538:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941001.820548:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff91d03ec599d8 from 1 10000000:01000000:3.0:1788941001.820552:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788941001.820604:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.820618:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.820638:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941001.820665:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945004928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941001.820713:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941001.820761:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310790c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941001.820946:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945004928 00000100:00100000:1.0:1788941001.820961:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945004928 00000100:00100000:1.0:1788941001.821048:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941001.821073:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+5:22706:x1875839945004928:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941001.821090:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941001.821112:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219c00/0x9c34acc08badead8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badead1 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.821141:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219c00/0x9c34acc08badead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badead1 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.821154:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219c00/0x9c34acc08badead8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badead1 expref: 6 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.821162:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219c00, rc 0) 00000100:00100000:1.0:1788941001.821248:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+6:22706:x1875839945004928:12345-0@lo:101:mount.lustre.0 Request processed in 177us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941001.821284:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941001.824420:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945004928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941001.824463:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.824480:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941001.824651:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941001.824740:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941001.824813:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941001.825725:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005056 00000100:00100000:2.0:1788941001.825739:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005056 00000100:00100000:2.0:1788941001.825809:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941001.825821:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+6:22706:x1875839945005056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941001.825964:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+6:22706:x1875839945005056:12345-0@lo:501:mount.lustre.0 Request processed in 145us (1224us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788941001.825983:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941001.829381:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005056:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788941001.829459:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788941001.829482:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.829505:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941001.829517:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d0065f9800 10000000:01000000:3.0:1788941001.829529:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788941001.829536:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d0065f9800 10000000:01000000:3.0:1788941001.829539:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788941001.829542:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91d0065f9800 from 1 10000000:01000000:3.0:1788941001.829545:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788941001.829595:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.829606:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.829621:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941001.829652:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005184:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941001.829735:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941001.829855:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310790c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941001.830186:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005184 00000100:00100000:2.0:1788941001.830196:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005184 00000100:00100000:2.0:1788941001.830358:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941001.830466:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+6:22706:x1875839945005184:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941001.830543:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941001.830564:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936a00/0x9c34acc08badeae6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeadf expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.830599:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936a00/0x9c34acc08badeae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeadf expref: 7 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.830611:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936a00/0x9c34acc08badeae6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeadf expref: 7 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941001.830621:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936a00, rc 0) 00000100:00100000:3.0:1788941001.830679:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+7:22706:x1875839945005184:12345-0@lo:101:mount.lustre.0 Request processed in 309us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941001.830687:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941001.830760:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005184:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941001.830793:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeae6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.830808:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeae6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941001.830833:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788941001.830851:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeae6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.831404:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035936600/0x9c34acc08badeadf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeae6 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941001.831413:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788941001.831421:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788941001.831440:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d0065f9800 10000000:01000000:0.0:1788941001.831444:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788941001.831448:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788941001.831451:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788941001.831516:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.831524:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.831534:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941001.831553:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005312:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941001.831609:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941001.831648:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc600 going to sleep for 11 seconds 00000100:00100000:1.0:1788941001.831671:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005312 00000100:00100000:1.0:1788941001.831681:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005312 00000100:00100000:1.0:1788941001.831727:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941001.831738:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+7:22706:x1875839945005312:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941001.831749:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941001.831763:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218200/0x9c34acc08badeaf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeaed expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.831783:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218200/0x9c34acc08badeaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeaed expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.831792:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218200/0x9c34acc08badeaf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeaed expref: 8 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941001.831813:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218200, rc 0) 00000100:00100000:1.0:1788941001.831860:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+8:22706:x1875839945005312:12345-0@lo:101:mount.lustre.0 Request processed in 125us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941001.831866:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941001.832232:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005312:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941001.832250:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeaf4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.832285:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeaf4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941001.832365:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005440:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941001.832401:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941001.832441:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cc600 going to sleep for 11 seconds 00000100:00100000:3.0:1788941001.832603:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005440 00000100:00100000:3.0:1788941001.832609:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005440 00000100:00100000:3.0:1788941001.832651:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941001.832659:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+8:22706:x1875839945005440:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941001.832808:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+9:22706:x1875839945005440:12345-0@lo:501:mount.lustre.0 Request processed in 150us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941001.832815:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941001.833155:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941001.833408:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941001.833449:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941001.833469:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024b5a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788941001.835122:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005568 00000100:00100000:0.0:1788941001.835136:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005568 00000100:00100000:0.0:1788941001.835208:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941001.835229:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+9:22706:x1875839945005568:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941001.836865:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+9:22706:x1875839945005568:12345-0@lo:503:mount.lustre.0 Request processed in 1629us (3406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941001.836877:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941001.836936:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945005568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941001.837847:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22745:1875839945005696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788941001.837922:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941001.837965:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d034704780 going to sleep for 11 seconds 00000100:00100000:0.0:1788941001.839019:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005696 00000100:00100000:0.0:1788941001.839030:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005696 00000100:00100000:0.0:1788941001.839141:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941001.839163:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+9:22745:x1875839945005696:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941001.841165:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+9:22745:x1875839945005696:12345-0@lo:502:llog_process_th.0 Request processed in 1996us (3232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941001.841179:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941001.848430:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22745:1875839945005696:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788941001.848484:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941001.848501:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.848504:0:22745:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788941001.848511:0:22745:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788941001.848517:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941001.848534:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91d0050e0000) 00000020:00000080:1.0:1788941001.848558:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788941001.848565:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788941001.848659:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788941001.848666:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb02 00000020:00000080:1.0:1788941001.848925:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788941001.848930:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941001.848934:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.848936:0:22745:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788941001.848938:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941001.848943:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.848955:0:22745:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788941001.848961:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941001.848969:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000 (ffff91d0050e19d8) 00000020:00000080:1.0:1788941001.848980:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788941001.848984:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788941001.848986:0:22745:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788941001.848989:0:22745:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788941001.848994:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788941001.849059:0:22745:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d0065f9800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788941001.849073:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0000 (ffff91d0050e33b0) 00000020:00000080:1.0:1788941001.849081:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788941001.849149:0:22745:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788941001.849156:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badeb17 00000020:00000080:1.0:1788941001.849252:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788941001.849291:0:22745:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788941001.849296:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x9c34acc08badeb1e 00080000:01000000:1.0:1788941001.849301:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788941001.849314:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb25 00010000:00010000:2.0:1788941001.936822:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788941001.937540:0:22745:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934627 00000001:00080000:2.0:1788941001.937969:0:22745:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788941001.938465:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-QMT0000 (ffff91cf063219d8) 00000020:00000080:2.0:1788941001.938485:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788941001.938553:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788941001.938560:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb33 00000020:00000080:0.0:1788941001.944449:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788941001.953005:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x9c34acc08badeb3a 00000020:00000080:1.0:1788941001.954016:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788941001.954039:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941001.954047:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.954049:0:22745:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788941001.954052:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788941001.954055:0:22745:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1788941001.954056:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941001.954057:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941001.954059:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788941001.954061:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.954063:0:22745:0:(obd_config.c:1662:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788941001.954065:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941001.954069:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.954070:0:22745:0:(obd_config.c:1662:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788941001.954075:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788941001.954123:0:22745:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788941001.954141:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941001.954144:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.954145:0:22745:0:(obd_config.c:1662:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788941001.954148:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941001.954150:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941001.954152:0:22745:0:(obd_config.c:1662:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:1.0:1788941001.954154:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788941001.954160:0:22745:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:1.0:1788941001.954186:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941001.954201:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff91d0050e4d88) 00000020:00000080:1.0:1788941001.954215:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788941001.954219:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788941001.954431:0:22745:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:1.0:1788941001.954437:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788941001.954444:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb48 00010000:00080000:1.0:1788941001.954476:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d039a45000@lustre-MDT0001-osp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788941001.959502:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788941001.960669:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941001.960681:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788941001.960714:0:22745:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788941001.960732:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badeb4f 00000100:00080000:3.0:1788941001.960748:0:22745:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941001.960754:0:22745:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941001.960789:0:22745:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a52a00 x1875839945005824/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941001.960851:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945005824:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941001.960934:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941001.961035:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945005824 00000100:00100000:1.0:1788941001.961043:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945005824 00000100:00100000:1.0:1788941001.961079:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941001.961086:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945005824:12345-0@lo:38:llog_process_th.0 00010000:00020000:1.0:1788941001.961101:0:22732:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788941001.965004:0:22745:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788941001.965118:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941001.965126:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.965128:0:22745:0:(obd_config.c:1662:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788941001.965131:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788941001.965134:0:22745:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788941001.965135:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941001.965137:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788941001.965138:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788941001.965141:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.965142:0:22745:0:(obd_config.c:1662:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788941001.965145:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788941001.965150:0:22745:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788941001.965154:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.965155:0:22745:0:(obd_config.c:1662:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788941001.965158:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941001.965162:0:22745:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:3.0:1788941001.965186:0:22745:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788941001.965189:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941001.965207:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91d03ec5cd88) 00000020:00000080:3.0:1788941001.965227:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788941001.965232:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788941001.965350:0:22745:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788941001.965357:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788941001.965364:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb5d 00010000:00080000:3.0:1788941001.965397:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d034738000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788941001.965635:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788941001.971390:0:22745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941001.971575:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788941001.975550:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941001.976590:0:22745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1788941001.976768:0:22745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:2.0:1788941001.980053:0:22752:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788941001.980061:0:22752:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788941001.981348:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788941001.981363:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788941001.981406:0:22745:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788941001.981426:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badeb64 00000100:00080000:0.0:1788941001.981438:0:22745:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788941001.981444:0:22745:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d034738000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941001.981497:0:22745:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475dc00 x1875839945005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788941001.981532:0:22745:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788941001.981590:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941001.981594:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941001.981596:0:22745:0:(obd_config.c:1662:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788941001.981599:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788941001.981607:0:22745:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788941001.981609:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941001.981610:0:22745:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941001.981612:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788941001.981615:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941001.981616:0:22745:0:(obd_config.c:1662:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788941001.981618:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788941001.981622:0:22745:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788941001.981625:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941001.981626:0:22745:0:(obd_config.c:1662:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788941001.981629:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788941001.981633:0:22745:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:0.0:1788941001.981654:0:22745:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788941001.981656:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788941001.981666:0:22745:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91d017e58000) 00000020:00000080:0.0:1788941001.981677:0:22745:0:(obd_config.c:786:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788941001.981681:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788941001.981732:0:22745:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788941001.981738:0:22745:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788941001.981743:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x9c34acc08badeb72 00010000:00080000:0.0:1788941001.981770:0:22745:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03fae8000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788941001.982091:0:22745:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788941001.982160:0:22745:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788941001.982175:0:22745:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788941001.982452:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945005952:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788941001.982509:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945005952 offset 0 length 520: 4 00000040:00080000:3.0:1788941001.991847:0:22745:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941001.994191:0:22745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1788941001.994402:0:22745:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:1.0:1788941001.994804:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945005824:12345-0@lo:38:llog_process_th.0 Request processed in 33712us (33865us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941001.994817:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788941001.994890:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941001.994896:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941001.994900:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945005824:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1788941001.996058:0:22754:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941001.996063:0:22754:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788941001.997019:0:22745:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788941001.997097:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788941001.997139:0:22745:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788941001.997161:0:22745:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badeb79 00000100:00080000:3.0:1788941001.997171:0:22745:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941001.997176:0:22745:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941001.997223:0:22745:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a50380 x1875839945006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941001.997311:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945006080:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788941001.997363:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945006080 offset 0 length 520: 4 00000100:00080000:3.0:1788941001.997443:0:22745:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788941001.997495:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941001.997499:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.997501:0:22745:0:(obd_config.c:1662:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788941001.997504:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941001.997508:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.997510:0:22745:0:(obd_config.c:1662:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788941001.997513:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788941001.997514:0:22745:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788941001.997516:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941001.997519:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.997520:0:22745:0:(obd_config.c:1662:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788941001.997523:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941001.997531:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941001.997533:0:22745:0:(obd_config.c:1662:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788941001.997537:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788941001.997565:0:22745:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22745:1875839945006208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788941001.997611:0:22745:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941001.997628:0:22745:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0347040c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941001.997747:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006208 00000100:00100000:0.0:1788941001.997754:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006208 00000100:00100000:0.0:1788941001.997796:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788941001.997805:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+9:22745:x1875839945006208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941001.997937:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+9:22745:x1875839945006208:12345-0@lo:502:llog_process_th.0 Request processed in 132us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941001.997944:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941001.998050:0:22745:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22745:1875839945006208:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788941001.998075:0:22745:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941001.998079:0:22745:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941001.998081:0:22745:0:(obd_config.c:1662:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788941001.998085:0:22745:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:0.0:1788941001.998347:0:22706:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:0.0:1788941001.998371:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788941001.998393:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeaf4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998404:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584de00/0x9c34acc08badeaed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeaf4 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941001.998413:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d0065f9800 from 1 10000000:01000000:0.0:1788941001.998416:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941001.998440:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998449:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998460:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941001.998475:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006336:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941001.998503:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941001.998521:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941001.998539:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006336 00000100:00100000:0.0:1788941001.998543:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006336 00000100:00100000:0.0:1788941001.998566:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941001.998572:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+9:22706:x1875839945006336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941001.998582:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941001.998596:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeb80 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998630:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998641:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998650:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788941001.998680:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+10:22706:x1875839945006336:12345-0@lo:101:mount.lustre.0 Request processed in 108us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941001.998686:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941001.998718:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006336:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941001.998729:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941001.998737:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941001.999328:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006464:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788941001.999366:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941001.999382:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941001.999398:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006464 00000100:00100000:0.0:1788941001.999403:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006464 00000100:00100000:0.0:1788941001.999424:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941001.999430:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+10:22706:x1875839945006464:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788941001.999442:0:22722:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788941001.999448:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788941001.999509:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+10:22706:x1875839945006464:12345-0@lo:256:mount.lustre.0 Request processed in 79us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941001.999515:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941001.999550:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006464:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788941002.000038:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941002.000047:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000056:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941002.000063:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d0065f9800 from 1 10000000:01000000:0.0:1788941002.000065:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941002.000085:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000091:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000100:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941002.000113:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006592:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941002.000140:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.000156:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.000171:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006592 00000100:00100000:0.0:1788941002.000175:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006592 00000100:00100000:0.0:1788941002.000201:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788941002.000208:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+10:22706:x1875839945006592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941002.000223:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941002.000234:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeb8e expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000252:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000283:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000290:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c000, rc 0) 00000100:00100000:0.0:1788941002.000329:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945006592:12345-0@lo:101:mount.lustre.0 Request processed in 122us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.000335:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788941002.000370:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006592:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941002.000381:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.000388:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941002.000437:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941002.000460:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.000472:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.000484:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006720 00000100:00100000:0.0:1788941002.000487:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006720 00000100:00100000:0.0:1788941002.000506:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941002.000511:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945006720:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941002.000629:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945006720:12345-0@lo:501:mount.lustre.0 Request processed in 118us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.000635:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941002.000661:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006720:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941002.000684:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941002.000715:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.000726:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.000736:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006848 00000100:00100000:0.0:1788941002.000739:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006848 00000100:00100000:0.0:1788941002.000755:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941002.000760:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945006848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941002.000826:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945006848:12345-0@lo:503:mount.lustre.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.000833:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788941002.000871:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945006848:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941002.001077:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22756:1875839945006976:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941002.001107:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.001126:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945006976 00000100:00100000:0.0:1788941002.001129:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945006976 00000100:00100000:0.0:1788941002.001149:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941002.001154:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22756:x1875839945006976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941002.001299:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941002.004958:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22756:x1875839945006976:12345-0@lo:502:llog_process_th.0 Request processed in 3797us (3843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941002.004969:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788941002.005314:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22756:1875839945006976:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788941002.005348:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941002.005365:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005368:0:22756:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788941002.005374:0:22756:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d0065f9800 00000020:00000080:0.0:1788941002.005377:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941002.005385:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941002.005387:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005388:0:22756:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788941002.005391:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941002.005393:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005394:0:22756:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788941002.005397:0:22756:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d0065f9800 00000020:00000080:0.0:1788941002.005399:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941002.005453:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941002.005456:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005458:0:22756:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788941002.005460:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941002.005462:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005463:0:22756:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788941002.005466:0:22756:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d0065f9800 00000020:00000080:0.0:1788941002.005468:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941002.005484:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941002.005487:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005488:0:22756:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788941002.005490:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941002.005492:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.005494:0:22756:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788941002.005497:0:22756:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d0065f9800 00000020:00000080:0.0:1788941002.005499:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788941002.005547:0:22756:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22756:1875839945007104:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788941002.005599:0:22756:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.005629:0:22756:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c83c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941002.007421:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007104 00000100:00100000:1.0:1788941002.007435:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007104 00000100:00100000:1.0:1788941002.007498:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941002.007508:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+11:22756:x1875839945007104:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.007671:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+11:22756:x1875839945007104:12345-0@lo:502:llog_process_th.0 Request processed in 164us (2071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941002.007677:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788941002.007809:0:22756:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22756:1875839945007104:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788941002.007848:0:22756:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941002.007856:0:22756:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941002.007858:0:22756:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788941002.007932:0:22756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788941002.010073:0:22706:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788941002.010108:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788941002.010127:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.010141:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941002.010195:0:22706:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788941002.010198:0:22706:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d0065f9800 10000000:01000000:1.0:1788941002.010201:0:22706:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d0065f9800 10000000:01000000:1.0:1788941002.010205:0:22706:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788941002.010210:0:22706:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d0065f9800 from 1 10000000:01000000:1.0:1788941002.010213:0:22706:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788941002.010247:0:22706:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.010279:0:22706:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.010315:0:22706:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941002.010339:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788941002.010398:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.010437:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.010698:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007232 00000100:00100000:0.0:1788941002.010706:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007232 00000100:00100000:0.0:1788941002.010757:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788941002.010767:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22706:x1875839945007232:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941002.010780:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941002.010792:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c600/0x9c34acc08badeba3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeb9c expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.010816:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c600/0x9c34acc08badeba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeb9c expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.010828:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c600/0x9c34acc08badeba3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeb9c expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.010836:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c600, rc 0) 00000100:00100000:0.0:1788941002.010890:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945007232:12345-0@lo:101:mount.lustre.0 Request processed in 126us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.010897:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941002.011052:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941002.011067:0:22706:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeba3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.011074:0:22706:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeba3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941002.011122:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941002.011144:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.011168:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.011254:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007360 00000100:00100000:0.0:1788941002.011281:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007360 00000100:00100000:0.0:1788941002.011313:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788941002.011320:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945007360:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941002.011426:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945007360:12345-0@lo:501:mount.lustre.0 Request processed in 106us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.011442:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788941002.012743:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941002.012790:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941002.012842:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.012885:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941002.012902:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007488 00000100:00100000:1.0:1788941002.012907:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007488 00000100:00100000:1.0:1788941002.012943:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788941002.012951:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945007488:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941002.013049:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945007488:12345-0@lo:503:mount.lustre.0 Request processed in 98us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941002.013062:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788941002.013104:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945007488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941002.014347:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945007616:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.014403:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.014429:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007616 00000100:00100000:1.0:1788941002.014435:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007616 00000100:00100000:1.0:1788941002.014466:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941002.014474:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945007616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.014588:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945007616:12345-0@lo:502:llog_process_th.0 Request processed in 114us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941002.014595:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941002.014639:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941002.014657:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945007616:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1788941002.014711:0:22758:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788941002.014726:0:22758:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91d0046433b0) 00000020:00000080:1.0:1788941002.014746:0:22758:0:(obd_config.c:786:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:1.0:1788941002.018799:0:22758:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d0065f9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788941002.018809:0:22758:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d0065f9800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788941002.018812:0:22758:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d0065f9800 4 00010000:00080000:1.0:1788941002.018854:0:22758:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf07a1b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788941002.024802:0:22758:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:1.0:1788941002.025006:0:22758:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788941002.025049:0:22758:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788941002.025063:0:22758:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x9c34acc08badebb1 00000100:00080000:1.0:1788941002.025073:0:22758:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941002.025079:0:22758:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91cf07a1b000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941002.025122:0:22758:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a3800 x1875839945007744/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941002.025162:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839945007744:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941002.025231:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.030717:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007744 00000100:00100000:1.0:1788941002.030738:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007744 00000100:00100000:1.0:1788941002.030791:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941002.030800:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839945007744:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941002.030900:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839945007744:12345-0@lo:38:llog_process_th.0 Request processed in 99us (5668us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788941002.030907:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941002.030984:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941002.030992:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941002.031010:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788941002.031014:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839945007744:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788941002.031182:0:22758:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788941002.033434:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945007872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.033520:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.033701:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945007872 00000100:00100000:0.0:1788941002.033709:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945007872 00000100:00100000:0.0:1788941002.033754:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788941002.033762:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945007872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.034122:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.034485:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945007872:12345-0@lo:502:llog_process_th.0 Request processed in 722us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.034494:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788941002.038212:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945007872:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.038321:0:22758:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945008000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.038387:0:22758:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.038424:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008000 00000100:00100000:1.0:1788941002.038431:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008000 00000100:00100000:1.0:1788941002.038483:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788941002.038498:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945008000:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788941002.039107:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:22758:x1875839945008000:12345-0@lo:502:llog_process_th.0 Request processed in 607us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941002.039116:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788941002.039172:0:22758:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d031079a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941002.039188:0:22758:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:66773969-0b9c-4025-866a-db20e971736d:22758:1875839945008000:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788941002.039213:0:22758:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788941002.039299:0:22706:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788941002.039332:0:22706:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788941002.039346:0:22706:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeba3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.039358:0:22706:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001219600/0x9c34acc08badeb9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeba3 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788941002.039406:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788941002.039409:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788941002.039410:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941002.039411:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941002.039412:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941002.039414:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941002.039415:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941002.039417:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788941002.039419:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941002.039420:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941002.039425:0:22706:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1788941002.039427:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788941002.039428:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788941002.039429:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941002.039430:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941002.039431:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941002.039432:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941002.039438:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941002.039439:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788941002.039440:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941002.039441:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941002.039455:0:22706:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788941002.039468:0:22706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945008128:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788941002.039500:0:22706:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.039522:0:22706:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00fdec0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.040715:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008128 00000100:00100000:0.0:1788941002.040724:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008128 00000100:00100000:0.0:1788941002.040766:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788941002.040776:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945008128:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941002.040804:0:22719:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788941002.040817:0:22719:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788941002.056165:0:22719:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788941002.056189:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788941002.056622:0:22743:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788941002.056628:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788941002.056652:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.056674:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.056683:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.056728:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.056746:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 12 pid: 22722 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941002.056761:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945008256:0@lo:104: 00000100:00100000:1.0:1788941002.056825:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941002.056868:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02c241600 going to sleep for 11 seconds 00000100:00100000:0.0:1788941002.057167:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008256 00000100:00100000:0.0:1788941002.057184:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008256 00000100:00100000:0.0:1788941002.057334:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788941002.057350:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945008256:12345-0@lo:104: 00010000:00010000:0.0:1788941002.057373:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.057483:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788941002.057490:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945008256:12345-0@lo:104: Request processed in 146us (665us total) trans 0 rc 0/0 00010000:00010000:3.0:1788941002.057495:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788941002.057504:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941002.058559:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945008256:0@lo:104: 00010000:00010000:1.0:1788941002.058590:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058680:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058688:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941002.058693:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058702:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941002.058709:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941002.058715:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788941002.058766:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058773:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941002.058805:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058813:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badeb80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb87 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941002.058842:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941002.058844:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941002.058846:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941002.058884:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945008384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941002.058962:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941002.059038:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008384 00000100:00100000:0.0:1788941002.059046:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008384 00010000:00010000:0.0:1788941002.059072:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 13 pid: 22722 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941002.059104:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788941002.059119:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+13:3647:x1875839945008384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941002.059154:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941002.059163:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 13 pid: 22722 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059179:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 13 pid: 22722 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059200:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584cc00/0x9c34acc08badeb87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badeb80 expref: 13 pid: 22722 timeout: 857 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059221:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059232:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788941002.059253:0:22712:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002624911s 00010000:00010000:0.0:1788941002.059290:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059299:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059333:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059341:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059349:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941002.059354:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059365:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059380:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941002.059394:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941002.059446:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+12:3647:x1875839945008384:12345-0@lo:103:ldlm_bl.0 Request processed in 333us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941002.059455:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941002.059464:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22706:x1875839945008128:12345-0@lo:253:mount.lustre.0 Request processed in 18685us (19957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941002.059487:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788941002.059505:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945008384:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941002.060299:0:22743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.060324:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941002.060333:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219000/0x9c34acc08badebb8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941002.060383:0:22706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:22706:1875839945008128:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788941002.060397:0:22706:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788941002.060401:0:22706:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788941002.060402:0:22706:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788941002.060403:0:22706:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941002.060405:0:22706:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941002.060406:0:22706:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941002.060407:0:22706:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941002.060408:0:22706:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941002.060410:0:22706:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788941002.060412:0:22706:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941002.060413:0:22706:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788941002.060426:0:22706:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:3.0:1788941002.084085:0:22706:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:3.0:1788941002.084660:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1788941002.085063:0:22769:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:00080000:3.0:1788941002.085506:0:22769:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941002.087542:0:22769:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788941002.087628:0:22769:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:2.0:1788941002.087911:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000020:00080000:1.0:1788941002.089450:0:22768:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:1.0:1788941002.089458:0:22768:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:2.0:1788941002.092598:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788941002.092793:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788941002.093474:0:22706:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788941002.093511:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788941002.093565:0:22706:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:3.0:1788941002.094208:0:22770:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff91d035a51180 x1875839945008512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941002.094225:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:2.0:1788941002.095583:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788941002.096404:0:22706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788941002.096445:0:22706:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788941002.097148:0:22706:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788941002.097937:0:22706:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1788941002.100159:0:22706:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788941002.102538:0:22706:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788941002.102587:0:22706:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffff9d5841537988 00100000:10000000:1.0:1788941002.102597:0:22706:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788941002.104007:0:22706:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788941002.104031:0:22706:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788941002.104057:0:22706:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1788941002.104079:0:22706:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:0.0:1788941002.105104:0:22706:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941002.105390:0:22706:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941002.591687:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941003.100892:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:0.0:1788941003.104955:0:22764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788941003.104969:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788941003.111560:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788941003.111582:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:1.0:1788941003.483530:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788941003.483545:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d0065f9800 from 11 10000000:01000000:1.0:1788941003.483554:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788941003.483642:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941003.483658:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941003.483674:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941003.483715:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945008640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941003.483833:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941003.483899:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941003.483969:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008640 00000100:00100000:0.0:1788941003.483982:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008640 00000100:00100000:0.0:1788941003.484066:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788941003.484078:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+11:22724:x1875839945008640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941003.484097:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941003.484116:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badebbf expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941003.484149:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badebbf expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941003.484164:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badebbf expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941003.484177:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ce00, rc 0) 00000100:00100000:0.0:1788941003.484244:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:22724:x1875839945008640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941003.484252:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788941003.484761:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945008640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941003.484783:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941003.484793:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941003.484890:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945008768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788941003.484932:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941003.486201:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941003.493068:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008768 00000100:00100000:2.0:1788941003.493095:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008768 00000100:00100000:2.0:1788941003.493186:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941003.493200:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22724:x1875839945008768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941003.493237:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941003.493281:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941003.493285:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1788941003.493491:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:22724:x1875839945008768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 293us (8556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941003.493500:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941003.493584:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945008768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788941003.493657:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788941003.493670:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941003.493683:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941003.612479:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788941004.124357:0:22764:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788941004.124367:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788941004.124492:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:0.0:1788941004.124527:0:22764:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788941004.124640:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788941004.124737:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941004.641752:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941005.149100:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941005.660399:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941006.187931:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941006.684416:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941007.195404:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000100:00080000:0.0:1788941007.519722:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788941007.519729:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788941007.519733:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788941007.519767:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:0.0:1788941007.519774:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788941007.519781:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941007.519803:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475ca80 x1875839945009024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788941007.519823:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941007.519827:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941007.519829:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941007.519846:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941007.519848:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788941007.519851:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788941007.519853:0:8:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788941007.519858:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91cf07a1b000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941007.519870:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475c000 x1875839945009152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941007.519896:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788941007.519912:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945008896:0@lo:400:kworker.0 00000100:00100000:0.0:1788941007.519985:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941007.520048:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009024:0@lo:38:kworker.0 00000100:00100000:0.0:1788941007.520091:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941007.520112:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839945009152:0@lo:38:kworker.0 00000100:00100000:0.0:1788941007.520175:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941007.520212:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008896 00000100:00100000:0.0:1788941007.520220:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008896 00000100:00100000:0.0:1788941007.520326:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941007.520337:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:3647:x1875839945008896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941007.520387:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:3647:x1875839945008896:12345-0@lo:400:kworker.0 Request processed in 51us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941007.520394:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941007.520459:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009024 00000100:00100000:0.0:1788941007.520464:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009024 00000100:00100000:0.0:1788941007.520486:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941007.520491:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945009024:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788941007.520508:0:22733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788941007.520543:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945009024:12345-0@lo:38:kworker.0 Request processed in 51us (451us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788941007.520550:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941007.520577:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009152 00000100:00100000:0.0:1788941007.520581:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009152 00000100:00100000:0.0:1788941007.520599:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941007.520604:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839945009152:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788941007.520629:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 762 last 0 00000020:00000080:0.0:1788941007.520665:0:22729:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x9c34acc08badebcd 00000004:00100000:0.0:1788941007.520679:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788941007.520794:0:22729:0:(import.c:65:import_set_state_nolock()) ffff91cf08ce4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941007.520822:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3644:x1875839945009152:12345-0@lo:38:kworker.0 Request processed in 217us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941007.520839:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941007.520883:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945008896:0@lo:400:kworker.0 00000100:00080000:0.0:1788941007.520905:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941007.520908:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788941007.520911:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009024:0@lo:38:kworker.0 00010000:00080000:0.0:1788941007.520918:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d03475c000 x1875839945009152/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788941007.520927:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788941007.520932:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788941007.520935:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788941007.520936:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07a1b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788941007.520939:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3644:1875839945009152:0@lo:38:kworker.0 00010000:00010000:2.0:1788941007.707455:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941008.219532:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000001:02000400:0.0:1788941008.552431:0:23012:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788941008.734189:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941009.243499:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941009.759225:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788941010.023223:0:23065:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941010.023467:0:23065:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788941010.269371:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:0.0:1788941010.779728:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941011.291463:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000020:00000004:1.0:1788941011.575609:0:23115:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788941011.575862:0:23115:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788941011.612487:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941001/real 1788941001] req@ffff91d035a50380 x1875839945006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941011.612520:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d035a50380 x1875839945006080/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941011.612530:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941001/real 1788941001] req@ffff91d03475dc00 x1875839945005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941011 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941011.612545:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03475dc00 x1875839945005952/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941011 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788941011.612564:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941011.612588:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941011.612592:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945006080:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788941011.612597:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941011.612617:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941011.612620:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945005952:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788941011.613453:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788941011.613457:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788941011.613460:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941011.613466:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 762 00000100:00080000:1.0:1788941011.613471:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788941011.613477:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941011.613496:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a0000 x1875839945009408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941011.613509:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941011.613512:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788941011.613513:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941011.613516:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:1.0:1788941011.613519:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941011.613522:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d034738000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941011.613532:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a2680 x1875839945009536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941011.613540:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941011.613543:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788941011.613544:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788941011.613547:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 757 00000100:00080000:1.0:1788941011.613549:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788941011.613552:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941011.613572:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a3800 x1875839945009664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941011.613637:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945009280:0@lo:400:kworker.0 00000100:00100000:1.0:1788941011.613699:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941011.613790:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941011.613796:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945009792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941011.613835:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941011.613911:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009280 00000100:00100000:1.0:1788941011.613919:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009280 00000100:00100000:1.0:1788941011.613963:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788941011.613972:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:3645:x1875839945009280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941011.614018:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:3645:x1875839945009280:12345-0@lo:400:kworker.0 Request processed in 47us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941011.614025:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788941011.614077:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009792 00000100:00100000:1.0:1788941011.614080:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009792 00000100:00100000:1.0:1788941011.614104:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941011.614111:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945009792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941011.614141:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945009792:12345-0@lo:400:kworker.0 Request processed in 30us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941011.614146:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941011.614335:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009408:0@lo:38:kworker.0 00000100:00100000:1.0:1788941011.614363:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941011.614380:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009536:0@lo:8:kworker.0 00000400:00000100:1.0:1788941011.614399:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945009536 offset 0 length 520: 4 00000100:00100000:1.0:1788941011.614414:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009664:0@lo:8:kworker.0 00000400:00000100:1.0:1788941011.614434:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945009664 offset 0 length 520: 4 00000100:00100000:1.0:1788941011.614475:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009408 00000100:00100000:1.0:1788941011.614479:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009408 00000100:00100000:1.0:1788941011.614500:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941011.614505:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945009408:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788941011.614520:0:22733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788941011.614549:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945009408:12345-0@lo:38:kworker.0 Request processed in 43us (185us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941011.614554:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788941011.614585:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d03f8a2300 x1875839945009792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941027 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941011.614597:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945009792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941011.614604:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945009280:0@lo:400:kworker.0 00000100:00080000:1.0:1788941011.614626:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941011.614630:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941011.614633:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009408:0@lo:38:kworker.0 00010000:00010000:2.0:1788941011.805378:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941012.333908:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941012.827697:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941013.340617:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:3.0:1788941013.851419:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941014.364314:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:0.0:1788941014.364949:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788941014.885967:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941015.387579:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:3.0:1788941015.900487:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941016.411458:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000100:00080000:3.0:1788941016.734552:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:1.0:1788941016.734571:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945009920:0@lo:400:kworker.0 00000100:00080000:3.0:1788941016.734575:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788941016.734582:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941016.734589:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 766 00000100:00080000:3.0:1788941016.734595:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941016.734603:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941016.734629:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a53b80 x1875839945010048/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941016.734650:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941016.734654:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941016.734657:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941016.734660:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941016.734666:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941016.734729:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941016.734736:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945010176:0@lo:400:kworker.0 00000100:00100000:1.0:1788941016.734903:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941016.734950:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945010048:0@lo:38:kworker.0 00000100:00100000:3.0:1788941016.734978:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010176 00000100:00100000:3.0:1788941016.734988:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010176 00000100:00100000:1.0:1788941016.734993:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941016.735026:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945009920 00000100:00100000:1.0:1788941016.735030:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945009920 00000100:00100000:3.0:1788941016.735059:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941016.735067:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788941016.735073:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945010176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941016.735080:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:3647:x1875839945009920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941016.735134:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+12:3647:x1875839945009920:12345-0@lo:400:kworker.0 Request processed in 58us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941016.735140:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945010176:12345-0@lo:400:kworker.0 Request processed in 70us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941016.735145:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788941016.735154:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941016.735208:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010048 00000100:00100000:1.0:1788941016.735211:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010048 00000100:00100000:1.0:1788941016.735237:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941016.735242:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945010048:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788941016.735275:0:22733:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788941016.735306:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945010048:12345-0@lo:38:kworker.0 Request processed in 63us (315us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788941016.735311:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788941016.735345:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941016.735348:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941016.735352:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945010048:0@lo:38:kworker.0 00010000:00080000:1.0:1788941016.735388:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d035a50a80 x1875839945010176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941032 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941016.735398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945010176:0@lo:400:kworker.0 00000100:00100000:1.0:1788941016.735406:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945009920:0@lo:400:kworker.0 00010000:00010000:2.0:1788941016.925275:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941017.435381:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941017.957121:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941018.459343:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941018.975778:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941019.484491:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:3.0:1788941019.996802:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788941020.053516:0:23460:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788941020.053520:0:23460:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788941020.053522:0:23460:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788941020.053638:0:23460:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d03593f000 00000020:01000004:3.0:1788941020.053654:0:23460:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788941020.053758:0:23460:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788941020.053783:0:23460:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff91d03ec5b3b0) 00000020:00000080:3.0:1788941020.053803:0:23460:0:(obd_config.c:786:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788941020.186846:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:1.0:1788941020.194722:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.207581:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.208079:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.212472:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.213200:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.213658:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.214115:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.215406:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.217171:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.217829:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.218224:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.218629:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788941020.219829:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:0.0:1788941020.222603:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.222870:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.223589:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.224581:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.224866:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.232558:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.235450:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.237082:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.239122:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.239901:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.240551:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.240875:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.241108:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.242165:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.242779:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.244786:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.246403:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.248625:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.250658:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.251406:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.252641:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:3.0:1788941020.255089:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:3.0:1788941020.256168:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.257065:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.257593:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.260037:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.260872:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.261217:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788941020.261608:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.262226:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.262587:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788941020.262867:0:23460:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00080000:01000000:2.0:1788941020.265913:0:23460:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788941020.266627:0:23460:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:2.0:1788941020.266643:0:23460:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788941020.266658:0:23460:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badebdb 00000020:01000004:2.0:1788941020.266667:0:23460:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788941020.266854:0:23460:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788941020.266858:0:23460:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788941020.266864:0:23460:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:2.0:1788941020.266894:0:23460:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:2.0:1788941020.266898:0:23460:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788941020.275995:0:23460:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788941020.276039:0:23460:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788941020.276044:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788941020.276046:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788941020.276047:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941020.276048:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941020.276049:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941020.276051:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941020.276052:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941020.276054:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941020.276055:0:23460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788941020.276058:0:23460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788941020.276061:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788941020.276062:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788941020.276063:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941020.276064:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941020.276065:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941020.276066:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941020.276067:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941020.276068:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941020.276069:0:23460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788941020.276104:0:23460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788941020.276123:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010304:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788941020.276205:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.276322:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06e5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.276996:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010304 00000100:00100000:1.0:1788941020.277008:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010304 00000100:00100000:1.0:1788941020.277074:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788941020.277085:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:23460:x1875839945010304:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788941020.280932:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788941020.280955:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788941020.280964:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788941020.289600:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:23460:x1875839945010304:12345-0@lo:253:mount.lustre.0 Request processed in 12508us (13386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.289615:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788941020.292875:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010304:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788941020.292896:0:23460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788941020.292900:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788941020.292901:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788941020.292903:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941020.292904:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941020.292905:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941020.292907:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941020.292908:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788941020.292910:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941020.292911:0:23460:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941020.294587:0:23460:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d03593f000 from lustre-MDT0001 10000000:01000000:3.0:1788941020.294668:0:23460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788941020.294673:0:23460:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788941020.294681:0:23460:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d03ec599d8 local copy 00010000:00010000:3.0:1788941020.294693:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941020.294832:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010432:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941020.294902:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.295160:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.295245:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010432 00000100:00100000:1.0:1788941020.295252:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010432 00000100:00100000:1.0:1788941020.295329:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941020.295341:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:23460:x1875839945010432:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941020.295741:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+12:23460:x1875839945010432:12345-0@lo:501:mount.lustre.0 Request processed in 402us (837us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941020.295751:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788941020.295986:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010432:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788941020.296006:0:23460:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788941020.296032:0:23460:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788941020.296040:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.296051:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941020.296080:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d03593f000 10000000:01000000:3.0:1788941020.296086:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788941020.296090:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91d03ec599d8 10000000:01000000:3.0:1788941020.296093:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788941020.296096:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff91d03ec599d8 from 1 10000000:01000000:3.0:1788941020.296099:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788941020.296123:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.296153:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.296163:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941020.296180:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010560:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941020.296210:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.296251:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.296621:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010560 00000100:00100000:1.0:1788941020.296628:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010560 00000100:00100000:1.0:1788941020.296681:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941020.296688:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+12:23460:x1875839945010560:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941020.296701:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941020.296743:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219000/0x9c34acc08badebe9 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badebe2 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.296764:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219000/0x9c34acc08badebe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badebe2 expref: 13 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.296785:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219000/0x9c34acc08badebe9 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badebe2 expref: 13 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.296794:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219000, rc 0) 00000100:00100000:1.0:1788941020.296835:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+13:23460:x1875839945010560:12345-0@lo:101:mount.lustre.0 Request processed in 147us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.296841:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788941020.297146:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010560:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941020.297163:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebe9 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.297172:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badebe9 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941020.297190:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788941020.297206:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebe9 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.297214:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937c00/0x9c34acc08badebe2 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebe9 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941020.297222:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d03593f000 10000000:01000000:3.0:1788941020.297227:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788941020.297230:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff91d03593f000 from 1 10000000:01000000:3.0:1788941020.297233:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788941020.297250:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.297410:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.297418:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941020.297499:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010688:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941020.297533:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.297614:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.299313:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010688 00000100:00100000:0.0:1788941020.299331:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010688 00000100:00100000:0.0:1788941020.299389:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788941020.299400:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+13:23460:x1875839945010688:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.299416:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941020.299902:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584cc00/0x9c34acc08badebf7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badebf0 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.299933:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584cc00/0x9c34acc08badebf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badebf0 expref: 14 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.300060:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584cc00/0x9c34acc08badebf7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badebf0 expref: 14 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.300071:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584cc00, rc 0) 00000100:00100000:0.0:1788941020.300241:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+14:23460:x1875839945010688:12345-0@lo:101:mount.lustre.0 Request processed in 842us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.300249:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788941020.302118:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010688:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941020.302158:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebf7 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.302169:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badebf7 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941020.302187:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788941020.302243:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebf7 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.302252:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937a00/0x9c34acc08badebf0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badebf7 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941020.302274:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788941020.302283:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941020.302289:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d03593f000 10000000:01000000:3.0:1788941020.302294:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788941020.302298:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788941020.302301:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788941020.302333:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.302341:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.302350:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941020.302390:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010816:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941020.302455:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.302499:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.302675:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010816 00000100:00100000:1.0:1788941020.302683:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010816 00000100:00100000:1.0:1788941020.302738:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788941020.302748:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+14:23460:x1875839945010816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941020.302761:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941020.302775:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218000/0x9c34acc08badec05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badebfe expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.302794:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218000/0x9c34acc08badec05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badebfe expref: 15 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.302804:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218000/0x9c34acc08badec05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badebfe expref: 15 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.302812:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218000, rc 0) 00000100:00100000:1.0:1788941020.302856:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945010816:12345-0@lo:101:mount.lustre.0 Request processed in 109us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.302863:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788941020.303306:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941020.303320:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec05 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941020.303329:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badec05 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941020.310466:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788941020.311253:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941020.321573:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788941020.321637:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788941020.321650:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788941020.321666:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788941020.321678:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788941020.321757:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788941020.321777:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788941020.321788:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788941020.321800:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788941020.321812:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788941020.321825:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788941020.321837:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788941020.321848:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788941020.321860:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788941020.321873:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788941020.321885:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788941020.321897:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788941020.321922:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788941020.321931:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788941020.321938:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788941020.322197:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788941020.322214:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788941020.322229:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788941020.322244:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788941020.322482:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788941020.322504:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788941020.322528:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788941020.322539:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788941020.322551:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788941020.322564:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788941020.322575:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788941020.322586:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788941020.322598:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788941020.322610:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788941020.322623:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788941020.322636:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788941020.322650:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788941020.322665:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788941020.322681:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788941020.322706:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788941020.322721:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788941020.322734:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788941020.322746:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788941020.322757:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788941020.322784:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788941020.322789:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788941020.322912:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941020.322994:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.323042:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea180 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.323355:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945010944 00000100:00100000:1.0:1788941020.323364:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945010944 00000100:00100000:1.0:1788941020.323440:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788941020.323449:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945010944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941020.323609:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945010944:12345-0@lo:501:mount.lustre.0 Request processed in 161us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.323618:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941020.324341:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945010944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941020.324390:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941020.324636:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.324671:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ea180 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.324780:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011072 00000100:00100000:0.0:1788941020.324787:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011072 00000100:00100000:0.0:1788941020.324830:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788941020.324839:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011072:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941020.325728:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011072:12345-0@lo:503:mount.lustre.0 Request processed in 886us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.325738:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788941020.326332:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011072:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941020.327127:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941020.327230:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011200:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941020.327395:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.327445:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941020.327652:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011200 00000100:00100000:2.0:1788941020.327661:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011200 00000100:00100000:2.0:1788941020.327735:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788941020.327746:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011200:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941020.328996:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011200:12345-0@lo:502:mount.lustre.0 Request processed in 1246us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.329008:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788941020.329250:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011200:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941020.329499:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788941020.329711:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1788941020.329730:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1788941020.329744:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1788941020.329758:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1788941020.329771:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1788941020.329782:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1788941020.329793:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1788941020.329804:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1788941020.329815:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1788941020.329826:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1788941020.329837:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1788941020.329849:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1788941020.329863:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1788941020.329875:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1788941020.329888:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1788941020.329899:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1788941020.329912:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1788941020.329938:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1788941020.330402:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1788941020.330419:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1788941020.330672:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1788941020.330704:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1788941020.330723:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1788941020.330741:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1788941020.330756:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1788941020.330782:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1788941020.330801:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1788941020.330817:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1788941020.330832:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1788941020.330847:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1788941020.330862:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1788941020.330877:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1788941020.330891:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1788941020.330906:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1788941020.330921:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1788941020.330935:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1788941020.331076:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1788941020.331093:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1788941020.331116:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1788941020.331143:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1788941020.331161:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1788941020.331171:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1788941020.331183:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1788941020.331227:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011328:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941020.331375:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.331418:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0050ead80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941020.331652:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011328 00000100:00100000:2.0:1788941020.331661:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011328 00000100:00100000:2.0:1788941020.331728:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788941020.331738:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011328:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941020.331852:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945011328:12345-0@lo:502:mount.lustre.0 Request processed in 115us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.331860:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788941020.332319:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945011328:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941020.332390:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1788941020.332408:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788941020.336611:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941020.336625:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941020.336628:0:23464:0:(obd_config.c:1662:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788941020.336635:0:23464:0:(obd_config.c:2066:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788941020.336639:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941020.336656:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff91d005098000) 00000020:00000080:3.0:1788941020.336677:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788941020.336683:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788941020.336772:0:23464:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788941020.336782:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badec13 00000020:00000080:3.0:1788941020.337021:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788941020.337025:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941020.337029:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941020.337030:0:23464:0:(obd_config.c:1662:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788941020.337033:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941020.337036:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941020.337038:0:23464:0:(obd_config.c:1662:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788941020.337041:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941020.337048:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001 (ffff91d00509b3b0) 00000020:00000080:3.0:1788941020.337061:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788941020.337066:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788941020.337068:0:23464:0:(obd_config.c:1615:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788941020.337071:0:23464:0:(obd_config.c:1248:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788941020.337077:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788941020.337147:0:23464:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03593f000 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788941020.337159:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDD0001 (ffff91d00509cd88) 00000020:00000080:3.0:1788941020.337167:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788941020.337291:0:23464:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788941020.337298:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badec28 00000020:00000080:3.0:1788941020.337388:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788941020.337394:0:23464:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788941020.337398:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x9c34acc08badec2f 00080000:01000000:3.0:1788941020.337409:0:23464:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788941020.337414:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badec36 00010000:00010000:2.0:1788941020.429121:0:23464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788941020.430026:0:23464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1788941020.430352:0:23464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788941020.434109:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:3.0:1788941020.434120:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941020.434125:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941020.434127:0:23464:0:(obd_config.c:1662:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:3.0:1788941020.434138:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941020.434144:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941020.434146:0:23464:0:(obd_config.c:1662:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:3.0:1788941020.434149:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788941020.434155:0:23464:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:00000080:3.0:1788941020.434185:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788941020.434200:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff91d0050999d8) 00000020:00000080:3.0:1788941020.434224:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:3.0:1788941020.434229:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788941020.434328:0:23464:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:3.0:1788941020.434335:0:23464:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788941020.434341:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badec44 00010000:00080000:3.0:1788941020.434374:0:23464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03ec16000@lustre-MDT0000-osp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:2.0:1788941020.451672:0:23464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:0.0:1788941020.453480:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788941020.456127:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788941020.457006:0:23464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788941020.457034:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badec4b 00000100:00080000:1.0:1788941020.457044:0:23464:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941020.457049:0:23464:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff91d03ec16000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941020.457082:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a2300 x1875839945011456/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941020.457157:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945011456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941020.457346:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.458287:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011456 00000100:00100000:3.0:1788941020.458296:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011456 00000100:00100000:3.0:1788941020.458344:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941020.458351:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945011456:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788941020.458372:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 775 last 0 00000020:00000080:3.0:1788941020.458402:0:22733:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badec52 00000004:00100000:3.0:1788941020.458416:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788941020.458420:0:22733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:1.0:1788941020.459006:0:23464:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788941020.459060:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788941020.459066:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788941020.459069:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941020.459084:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 772 00000100:00080000:3.0:1788941020.459087:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788941020.459092:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941020.459115:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a52680 x1875839945011584/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:1.0:1788941020.459144:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.459153:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459155:0:23464:0:(obd_config.c:1662:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788941020.459159:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788941020.459161:0:23464:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788941020.459163:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.459164:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.459166:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788941020.459168:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459170:0:23464:0:(obd_config.c:1662:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788941020.459172:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941020.459177:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459179:0:23464:0:(obd_config.c:1662:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788941020.459183:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788941020.459238:0:23464:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788941020.459251:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.459253:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459275:0:23464:0:(obd_config.c:1662:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788941020.459278:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788941020.459280:0:23464:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788941020.459281:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.459282:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.459284:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788941020.459286:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459287:0:23464:0:(obd_config.c:1662:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788941020.459289:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788941020.459292:0:23464:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788941020.459295:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.459296:0:23464:0:(obd_config.c:1662:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788941020.459298:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788941020.459301:0:23464:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1788941020.459320:0:23464:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788941020.459322:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941020.459339:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff91d004640000) 00000020:00000080:1.0:1788941020.459354:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788941020.459358:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788941020.459435:0:23464:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1788941020.459442:0:23464:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788941020.459451:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badec60 00010000:00080000:1.0:1788941020.459480:0:23464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf079f8800@lustre-OST0000-osc-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788941020.460413:0:23464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00080000:3.0:1788941020.465019:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.465029:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941020.465032:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.465035:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788941020.465103:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945011712:0@lo:400:kworker.0 00000100:00100000:3.0:1788941020.465189:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.465246:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011712 00000100:00100000:3.0:1788941020.465254:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011712 00000100:00100000:3.0:1788941020.465316:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788941020.465325:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945011712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941020.465372:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945011712:12345-0@lo:400:kworker.0 Request processed in 49us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941020.465379:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788941020.465418:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d035a51880 x1875839945011712/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941036 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941020.465433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945011712:0@lo:400:kworker.0 00000040:01000000:3.0:1788941020.470886:0:23464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788941020.472364:0:23464:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1788941020.476062:0:22733:0:(import.c:65:import_set_state_nolock()) ffff91d03ec17000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788941020.476798:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839945011456:12345-0@lo:38:llog_process_th.0 Request processed in 18443us (19450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941020.476808:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:1.0:1788941020.477004:0:23464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788941020.477435:0:23464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788941020.477703:0:23464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00100000:1.0:1788941020.478100:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945011584:0@lo:38:kworker.0 00000100:00100000:1.0:1788941020.478177:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.478240:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941020.478251:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788941020.478285:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788941020.478299:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788941020.478302:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ec16000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788941020.478314:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945011456:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941020.478390:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011584 00000100:00100000:0.0:1788941020.478399:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011584 00000100:00100000:0.0:1788941020.478434:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941020.478442:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945011584:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788941020.478496:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3644:x1875839945011584:12345-0@lo:38:kworker.0 Request processed in 55us (321us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788941020.482750:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941020.483381:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941020.483390:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941020.483396:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788941020.483400:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945011584:0@lo:38:kworker.0 00000100:00100000:0.0:1788941020.483624:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945011840:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941020.483703:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.483839:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945011840 00000100:00100000:2.0:1788941020.483846:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945011840 00000100:00100000:2.0:1788941020.483885:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941020.483891:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839945011840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788941020.483919:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941020.483971:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3646:x1875839945011840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.483977:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941020.484320:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945011840:0@lo:41:osp-pre-0-1.0 00000040:00080000:3.0:1788941020.486639:0:23469:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941020.486648:0:23469:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788941020.497028:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788941020.497045:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788941020.497093:0:23464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788941020.497115:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badec67 00000100:00080000:1.0:1788941020.497127:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941020.497427:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91cf079f8800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941020.497468:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a2300 x1875839945011968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941020.497558:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945011968:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788941020.497630:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945011968 offset 0 length 520: 4 00000100:00080000:1.0:1788941020.497754:0:23464:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788941020.497815:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.497820:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.497822:0:23464:0:(obd_config.c:1662:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788941020.497825:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788941020.497828:0:23464:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788941020.497830:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.497831:0:23464:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788941020.497833:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788941020.497836:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.497837:0:23464:0:(obd_config.c:1662:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788941020.497839:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788941020.497849:0:23464:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788941020.497854:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.497855:0:23464:0:(obd_config.c:1662:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788941020.497859:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788941020.497863:0:23464:0:(obd_config.c:1586:class_process_config()) adding mapping from uuid 192.168.202.125@tcp to nid 0x20000c0a8ca7d (192.168.202.125@tcp) 00000020:01000000:1.0:1788941020.497883:0:23464:0:(obd_config.c:2073:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788941020.497885:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941020.497898:0:23464:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff91d0046419d8) 00000020:00000080:1.0:1788941020.497912:0:23464:0:(obd_config.c:786:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1788941020.497917:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788941020.497979:0:23464:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788941020.497987:0:23464:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788941020.497993:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x9c34acc08badec75 00010000:00080000:1.0:1788941020.498020:0:23464:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d00d252800@lustre-OST0001-osc-MDT0001: add connection 192.168.202.125@tcp at head 00000100:00080000:3.0:1788941020.498277:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.498282:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941020.498285:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.498288:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:1.0:1788941020.498758:0:23464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1788941020.498834:0:23464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788941020.498850:0:23464:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788941020.504547:0:23464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788941020.504984:0:23464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788941020.505115:0:23464:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788941020.505723:0:23471:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788941020.505728:0:23471:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788941020.506786:0:23464:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788941020.506800:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788941020.506848:0:23464:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788941020.506874:0:23464:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badec7c 00000100:00080000:1.0:1788941020.506886:0:23464:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941020.506892:0:23464:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941020.506935:0:23464:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03f8a1880 x1875839945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941020.507029:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945012096:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788941020.507089:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945012096 offset 0 length 520: 4 00000100:00080000:1.0:1788941020.507186:0:23464:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788941020.507332:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.507345:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.507346:0:23464:0:(obd_config.c:1662:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788941020.507350:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941020.507354:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.507355:0:23464:0:(obd_config.c:1662:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788941020.507358:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788941020.507361:0:23464:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788941020.507363:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.507366:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.507368:0:23464:0:(obd_config.c:1662:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788941020.507370:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788941020.507372:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.507373:0:23464:0:(obd_config.c:1662:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788941020.507376:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788941020.507405:0:23464:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788941020.507409:0:23464:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941020.507410:0:23464:0:(obd_config.c:1662:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788941020.507413:0:23464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:0.0:1788941020.508686:0:23460:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:0.0:1788941020.508735:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1788941020.508755:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec05 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.508767:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035936800/0x9c34acc08badebfe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec05 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941020.508774:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03593f000 from 1 10000000:01000000:0.0:1788941020.508777:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941020.508814:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.508823:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.508834:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.508856:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012224:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941020.508913:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.508961:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d006999c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.512162:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012224 00000100:00100000:0.0:1788941020.512180:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012224 00000100:00100000:0.0:1788941020.512280:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941020.512292:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+15:23460:x1875839945012224:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.512324:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941020.512346:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badec83 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.512374:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badec83 expref: 16 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.512386:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badec83 expref: 16 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.512395:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584da00, rc 0) 00000100:00100000:0.0:1788941020.512475:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+16:23460:x1875839945012224:12345-0@lo:101:mount.lustre.0 Request processed in 186us (3562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.512482:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941020.512554:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012224:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.512575:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.512585:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.513161:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012352:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788941020.513206:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.513239:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26900 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.513279:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012352 00000100:00100000:0.0:1788941020.513284:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012352 00000100:00100000:0.0:1788941020.513314:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788941020.513322:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+16:23460:x1875839945012352:12345-0@lo:256:mount.lustre.0 20000000:01000000:0.0:1788941020.513344:0:22722:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788941020.513360:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788941020.513363:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:0.0:1788941020.513437:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+16:23460:x1875839945012352:12345-0@lo:256:mount.lustre.0 Request processed in 115us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.513443:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788941020.513478:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012352:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788941020.514064:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941020.514081:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514091:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941020.514099:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03593f000 from 1 10000000:01000000:0.0:1788941020.514101:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941020.514124:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514145:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514154:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.514169:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012480:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941020.514201:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.514217:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26900 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.514247:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012480 00000100:00100000:0.0:1788941020.514252:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012480 00000100:00100000:0.0:1788941020.514300:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788941020.514307:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+16:23460:x1875839945012480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.514317:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941020.514328:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badec91 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514347:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514356:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514364:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c800, rc 0) 00000100:00100000:0.0:1788941020.514393:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012480:12345-0@lo:101:mount.lustre.0 Request processed in 86us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.514398:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788941020.514435:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012480:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.514446:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.514454:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788941020.517650:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.517661:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941020.517664:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.517668:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941020.517759:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:2.0:1788941020.521502:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788941020.521866:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941020.522070:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788941020.522089:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788941020.522096:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788941020.522103:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788941020.522109:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788941020.522116:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788941020.522122:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788941020.522589:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788941020.522613:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788941020.522622:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788941020.522629:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788941020.522640:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788941020.522643:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788941020.522831:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941020.522907:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.523048:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.527180:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012608 00000100:00100000:1.0:1788941020.527198:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012608 00000100:00100000:1.0:1788941020.527284:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788941020.527295:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012608:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941020.527485:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012608:12345-0@lo:501:mount.lustre.0 Request processed in 192us (4578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.527493:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941020.527795:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941020.527852:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941020.527911:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.528015:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.528070:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012736 00000100:00100000:1.0:1788941020.528075:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012736 00000100:00100000:1.0:1788941020.528157:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788941020.528166:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941020.528309:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012736:12345-0@lo:503:mount.lustre.0 Request processed in 143us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.528323:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788941020.528393:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012736:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941020.529622:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941020.529904:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012864:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941020.530154:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.531517:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012864 00000100:00100000:0.0:1788941020.531530:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012864 00000100:00100000:0.0:1788941020.531581:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788941020.531591:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012864:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941020.531745:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012864:12345-0@lo:502:mount.lustre.0 Request processed in 155us (1591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.531754:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941020.531846:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941020.531875:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012864:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941020.532122:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788941020.532164:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788941020.532182:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788941020.532212:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788941020.532228:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788941020.532239:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788941020.532251:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788941020.532838:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788941020.532855:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788941020.532867:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788941020.532878:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788941020.532913:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012992:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941020.532970:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.533002:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.533217:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945012992 00000100:00100000:0.0:1788941020.533223:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945012992 00000100:00100000:0.0:1788941020.533281:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788941020.533381:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012992:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941020.533497:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945012992:12345-0@lo:502:mount.lustre.0 Request processed in 208us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.533505:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941020.533583:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945012992:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941020.533632:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788941020.533639:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788941020.534801:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941020.534814:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534816:0:23473:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788941020.534824:0:23473:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03593f000 00000020:00000080:2.0:1788941020.534827:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941020.534836:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941020.534838:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534839:0:23473:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788941020.534849:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941020.534851:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534852:0:23473:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788941020.534856:0:23473:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03593f000 00000020:00000080:2.0:1788941020.534858:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941020.534927:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941020.534931:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534932:0:23473:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788941020.534935:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941020.534937:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534939:0:23473:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788941020.534943:0:23473:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03593f000 00000020:00000080:2.0:1788941020.534946:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941020.534965:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941020.534968:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534970:0:23473:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788941020.534972:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941020.534974:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.534976:0:23473:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788941020.534979:0:23473:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03593f000 00000020:00000080:2.0:1788941020.534980:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788941020.535003:0:23473:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941020.535006:0:23473:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941020.535008:0:23473:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788941020.535010:0:23473:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:0.0:1788941020.535149:0:23460:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788941020.535181:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788941020.535208:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535220:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941020.535308:0:23460:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788941020.535311:0:23460:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d03593f000 10000000:01000000:0.0:1788941020.535315:0:23460:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d03593f000 10000000:01000000:0.0:1788941020.535319:0:23460:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788941020.535325:0:23460:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d03593f000 from 1 10000000:01000000:0.0:1788941020.535327:0:23460:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788941020.535362:0:23460:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535371:0:23460:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535389:0:23460:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.535415:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013120:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941020.535470:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.535502:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013120 00000100:00100000:0.0:1788941020.535523:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013120 00000100:00100000:0.0:1788941020.535553:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788941020.535561:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:23460:x1875839945013120:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.535574:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941020.535586:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d400/0x9c34acc08badeca6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badec9f expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535611:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d400/0x9c34acc08badeca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badec9f expref: 18 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535622:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d400/0x9c34acc08badeca6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badec9f expref: 18 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535630:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d400, rc 0) 00000100:00100000:0.0:1788941020.535663:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013120:12345-0@lo:101:mount.lustre.0 Request processed in 103us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941020.535670:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788941020.535719:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a263c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941020.535738:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013120:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941020.535751:0:23460:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeca6 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.535766:0:23460:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeca6 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941020.544533:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:2.0:1788941020.544940:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941020.545144:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:2.0:1788941020.545170:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:2.0:1788941020.545183:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:2.0:1788941020.545196:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:2.0:1788941020.545222:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:2.0:1788941020.545239:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:2.0:1788941020.545286:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:2.0:1788941020.545303:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:2.0:1788941020.545317:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:2.0:1788941020.545330:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:2.0:1788941020.545344:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:2.0:1788941020.545358:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:2.0:1788941020.545372:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:2.0:1788941020.545384:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:2.0:1788941020.545397:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:2.0:1788941020.545410:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:2.0:1788941020.545422:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:2.0:1788941020.545436:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:2.0:1788941020.545450:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:2.0:1788941020.545463:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:2.0:1788941020.545491:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:2.0:1788941020.545505:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:2.0:1788941020.545518:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:2.0:1788941020.545531:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:2.0:1788941020.545543:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:2.0:1788941020.545556:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:2.0:1788941020.545568:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:2.0:1788941020.545581:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:2.0:1788941020.545593:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:2.0:1788941020.545604:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:2.0:1788941020.545616:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:2.0:1788941020.545628:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:2.0:1788941020.545640:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:2.0:1788941020.545651:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:2.0:1788941020.545663:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:2.0:1788941020.545675:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:2.0:1788941020.545699:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:2.0:1788941020.545713:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:2.0:1788941020.545723:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:2.0:1788941020.545743:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:2.0:1788941020.545756:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:2.0:1788941020.545769:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:2.0:1788941020.545783:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:2.0:1788941020.545796:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:2.0:1788941020.545809:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:2.0:1788941020.545821:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:2.0:1788941020.545833:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:2.0:1788941020.545846:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:2.0:1788941020.545974:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:2.0:1788941020.545993:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:2.0:1788941020.546009:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:2.0:1788941020.546014:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:2.0:1788941020.546112:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013248:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941020.546198:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.546242:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.547077:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013248 00000100:00100000:1.0:1788941020.547087:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013248 00000100:00100000:1.0:1788941020.547140:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788941020.547151:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941020.547677:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013248:12345-0@lo:501:mount.lustre.0 Request processed in 525us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.547685:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788941020.547739:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013248:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941020.547784:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013376:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941020.547825:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.547851:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0210ff3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.547865:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013376 00000100:00100000:1.0:1788941020.547869:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013376 00000100:00100000:1.0:1788941020.547886:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788941020.547892:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013376:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941020.547966:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013376:12345-0@lo:503:mount.lustre.0 Request processed in 74us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.547973:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788941020.548009:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013376:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788941020.549220:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788941020.549417:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013504:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.549562:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.549599:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.549633:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013504 00000100:00100000:1.0:1788941020.549639:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013504 00000100:00100000:1.0:1788941020.549670:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941020.549678:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013504:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.549772:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013504:12345-0@lo:502:mount.lustre.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.549779:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941020.549827:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013504:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941020.550001:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788941020.550027:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788941020.550039:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788941020.550052:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788941020.550065:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788941020.550077:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788941020.550087:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788941020.550096:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788941020.550106:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788941020.550586:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788941020.550608:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788941020.550621:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788941020.550634:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788941020.550647:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788941020.550661:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788941020.550671:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788941020.550682:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788941020.550695:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788941020.550707:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788941020.550720:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788941020.550733:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788941020.550743:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788941020.550766:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788941020.550782:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788941020.550817:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788941020.550845:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788941020.550859:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788941020.550872:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788941020.550898:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788941020.550913:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788941020.550927:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788941020.550940:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788941020.550965:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788941020.550982:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788941020.550995:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788941020.551008:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788941020.551019:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788941020.551032:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788941020.551046:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788941020.551059:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788941020.551072:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788941020.551099:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788941020.551114:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788941020.551138:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788941020.551156:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788941020.551175:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788941020.551189:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788941020.551202:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788941020.551247:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013632:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.551388:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.551499:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013632 00000100:00100000:1.0:1788941020.551506:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013632 00000100:00100000:1.0:1788941020.551549:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941020.551558:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013632:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.551659:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013632:12345-0@lo:502:mount.lustre.0 Request processed in 102us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.551667:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941020.551713:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bca9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.551734:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013632:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941020.551884:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788941020.551903:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788941020.551922:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013760:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.551953:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.551974:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013760 00000100:00100000:1.0:1788941020.551978:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013760 00000100:00100000:1.0:1788941020.551998:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941020.552004:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013760:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941020.552058:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945013760:12345-0@lo:502:mount.lustre.0 Request processed in 54us (104us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.552065:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941020.552093:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.552105:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945013760:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941020.552951:0:23460:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788941020.552964:0:23460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788941020.563232:0:23477:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788941020.563251:0:23477:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff91d035a8b3b0) 00000020:00000080:3.0:1788941020.563292:0:23477:0:(obd_config.c:786:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788941020.563383:0:23477:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03593f000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788941020.563388:0:23477:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d03593f000 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788941020.563391:0:23477:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03593f000 3 00010000:00080000:3.0:1788941020.563423:0:23477:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d03ece3000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.202.125@tcp at head 00010000:00010000:3.0:1788941020.573184:0:23477:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788941020.573413:0:23477:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788941020.573457:0:23477:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788941020.573469:0:23477:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x9c34acc08badecb4 00000100:00080000:3.0:1788941020.573480:0:23477:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788941020.573486:0:23477:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff91d03ece3000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941020.573539:0:23477:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a51880 x1875839945013888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941020.573568:0:23477:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788941020.573595:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.573599:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941020.573602:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941020.573605:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788941020.574491:0:23477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788941020.574993:0:23460:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788941020.575025:0:23460:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788941020.575046:0:23460:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeca6 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.575058:0:23460:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d200/0x9c34acc08badec9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeca6 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788941020.575113:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788941020.575115:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788941020.575117:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941020.575118:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941020.575119:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941020.575121:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941020.575122:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941020.575124:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941020.575125:0:23460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941020.575138:0:23460:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788941020.575140:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788941020.575142:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788941020.575143:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941020.575144:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941020.575145:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941020.575146:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941020.575147:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941020.575148:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941020.575149:0:23460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941020.575171:0:23460:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788941020.575189:0:23460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945014016:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788941020.575275:0:23460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.575379:0:23460:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d035a3c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.575402:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839945013888:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941020.575444:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.575481:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945013888 00000100:00100000:1.0:1788941020.575488:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945013888 00000100:00100000:1.0:1788941020.575521:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941020.575528:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839945013888:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941020.575549:0:22728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 775 last 0 00000020:00000080:1.0:1788941020.575581:0:22728:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x9c34acc08badecbb 00000004:00100000:1.0:1788941020.575597:0:22728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941020.575638:0:22728:0:(import.c:65:import_set_state_nolock()) ffff91d0196c5000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941020.575690:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3644:x1875839945013888:12345-0@lo:38:llog_process_th.0 Request processed in 160us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.575697:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788941020.575735:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d035a51880 x1875839945013888/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941020.575745:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941020.575753:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788941020.575759:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788941020.575763:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788941020.575766:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03ece3000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788941020.575772:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3644:1875839945013888:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788941020.577645:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014016 00000100:00100000:2.0:1788941020.577659:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014016 00000100:00100000:2.0:1788941020.577708:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788941020.577715:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945014016:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788941020.577742:0:22721:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788941020.577753:0:22721:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1788941020.581149:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788941020.581230:0:22721:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788941020.581251:0:22721:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788941020.581557:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:23460:x1875839945014016:12345-0@lo:253:mount.lustre.0 Request processed in 3837us (6295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.581568:0:23460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:23460:1875839945014016:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788941020.581569:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 10000000:01000000:1.0:1788941020.581581:0:23460:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788941020.581585:0:23460:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788941020.581586:0:23460:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788941020.581587:0:23460:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941020.581588:0:23460:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941020.581590:0:23460:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941020.581591:0:23460:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941020.581592:0:23460:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788941020.581594:0:23460:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941020.581595:0:23460:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788941020.581610:0:23460:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:0.0:1788941020.583298:0:22743:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788941020.583307:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788941020.583331:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583349:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badebbf expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583357:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badec83 expref: 17 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583364:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583405:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 17 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583420:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 17 pid: 22721 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.583434:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945014144:0@lo:104: 00000100:00100000:0.0:1788941020.583490:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788941020.583539:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.583558:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 17 pid: 22722 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.583567:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945014272:0@lo:104: 00000100:00100000:0.0:1788941020.583589:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.583614:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941020.583621:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014144 00000100:00100000:1.0:1788941020.583630:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014144 00000100:00100000:1.0:1788941020.583662:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014272 00000100:00100000:1.0:1788941020.583665:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014272 00000100:00100000:1.0:1788941020.583680:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941020.583688:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945014144:12345-0@lo:104: 00000100:00100000:2.0:1788941020.583701:0:22711:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788941020.583707:0:22711:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:1.0:1788941020.583707:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.583764:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788941020.583770:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945014144:12345-0@lo:104: Request processed in 82us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.583777:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941020.583794:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941020.583801:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945014272:12345-0@lo:104: 00010000:00010000:1.0:1788941020.583808:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.583847:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788941020.583852:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945014272:12345-0@lo:104: Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.583858:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788941020.583885:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941020.583890:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.583896:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d600 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788941020.583900:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.583908:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941020.583915:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941020.583927:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788941020.584025:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584032:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941020.584052:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584059:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d600/0x9c34acc08badec83 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec8a expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584070:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941020.584073:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584078:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218a00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:1.0:1788941020.584081:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584087:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788941020.584094:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941020.584099:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788941020.584110:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584115:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941020.584138:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584145:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d001218a00/0x9c34acc08badebbf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badebc6 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584159:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941020.584161:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941020.584163:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941020.584176:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945014400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941020.584208:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.584233:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941020.584239:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945014528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941020.584398:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941020.584649:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941020.584708:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014400 00000100:00100000:1.0:1788941020.584714:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014400 00010000:00010000:1.0:1788941020.584739:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 18 pid: 22721 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941020.584763:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014528 00000100:00100000:1.0:1788941020.584766:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014528 00010000:00010000:1.0:1788941020.584777:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 19 pid: 22722 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941020.584789:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941020.584796:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+19:3647:x1875839945014400:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941020.584806:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941020.584810:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 19 pid: 22721 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584831:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 19 pid: 22721 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584847:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941020.584878:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+19:3647:x1875839945014400:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.584885:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941020.584898:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941020.584904:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+18:3647:x1875839945014528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941020.584912:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941020.584915:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 18 pid: 22722 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584924:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 18 pid: 22722 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.584935:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585016:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788941020.585032:0:22712:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002624911s 00010000:00010000:1.0:1788941020.585037:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585045:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585063:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585069:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585074:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ca00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941020.585078:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585085:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585094:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941020.585102:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941020.585125:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+18:3647:x1875839945014528:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941020.585141:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788941020.585204:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945014528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941020.585213:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945014400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941020.586111:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584da00/0x9c34acc08badec8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badec83 expref: 17 pid: 22721 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.586124:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945014144:0@lo:104: 00010000:00010000:0.0:1788941020.586148:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ce00/0x9c34acc08badebc6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badebbf expref: 16 pid: 22722 timeout: 875 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941020.586158:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945014272:0@lo:104: 00010000:00010000:0.0:1788941020.586174:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.586184:0:22743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.586191:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941020.586197:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ca00/0x9c34acc08badecc2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:0.0:1788941020.593457:0:23460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788941020.593602:0:23485:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788941020.593607:0:23485:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788941020.598733:0:23486:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788941020.598772:0:23460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000040:00080000:0.0:1788941020.603061:0:23486:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941020.603080:0:23487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945014656:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788941020.603173:0:23487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941020.603200:0:23487:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0029a0780 going to sleep for 11 seconds 00000100:00100000:2.0:1788941020.603286:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014656 00000100:00100000:2.0:1788941020.603293:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014656 00000100:00100000:2.0:1788941020.603335:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941020.603343:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945014656:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788941020.603411:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945014656:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.603419:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941020.604446:0:23487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945014656:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788941020.604484:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788941020.604525:0:23487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945014784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788941020.604569:0:23487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941020.604600:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014784 00000100:00100000:2.0:1788941020.604604:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014784 00000100:00100000:2.0:1788941020.604635:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941020.604641:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945014784:12345-0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788941020.605909:0:23486:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788941020.606053:0:23486:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:01000000:1.0:1788941020.607829:0:23460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788941020.607882:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788941020.608347:0:23460:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788941020.608360:0:23460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788941020.608400:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788941020.609225:0:23460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788941020.609547:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945014784:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 4901us (4973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.609558:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941020.609592:0:23487:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941020.609615:0:23487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945014784:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788941020.609691:0:23487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23487:1875839945014912:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788941020.609725:0:23487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788941020.609772:0:23460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000100:00100000:2.0:1788941020.609783:0:23487:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad9900 going to sleep for 11 seconds 00000040:01000000:1.0:1788941020.609800:0:23460:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788941020.610240:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945014912 00000100:00100000:3.0:1788941020.610248:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945014912 00000100:00100000:2.0:1788941020.610633:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941020.610644:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23487:x1875839945014912:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788941020.610757:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23487:x1875839945014912:12345-0@lo:900:lod0001_rec0000.0 Request processed in 115us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941020.610764:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788941020.610839:0:23487:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d005045c00 x1875839945014912/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941036 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941020.610853:0:23487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23487:1875839945014912:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788941020.610913:0:23487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945015040:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788941020.610959:0:23487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941020.611084:0:23487:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788941020.611145:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015040 00000100:00100000:3.0:1788941020.611150:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015040 00000100:00100000:3.0:1788941020.611214:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788941020.611223:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945015040:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788941020.611335:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23487:x1875839945015040:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 113us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941020.611342:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788941020.611401:0:23487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23487:1875839945015040:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788941020.611455:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788941020.613532:0:23487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788941020.613608:0:23487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788941020.613613:0:23487:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000040:00080000:1.0:1788941020.615624:0:23460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788941020.618913:0:23460:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788941020.625612:0:23460:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788941020.640055:0:23460:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788941020.640099:0:23460:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffff9d5841a37988 00100000:10000000:1.0:1788941020.640108:0:23460:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:2.0:1788941020.642603:0:23460:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788941020.642652:0:23460:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788941020.642670:0:23460:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788941020.642699:0:23460:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788941020.643433:0:23460:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941020.643646:0:23460:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788941021.022442:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941021.543739:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:1.0:1788941021.595958:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788941022.045063:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941022.555385:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:1.0:1788941022.620615:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788941022.621401:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788941022.621406:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03593f000 from 12 10000000:01000000:2.0:1788941022.621411:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788941022.621481:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941022.621495:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941022.621511:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941022.621543:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941022.621637:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941022.621701:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021ad93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941022.622096:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015168 00000100:00100000:3.0:1788941022.622107:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015168 00000100:00100000:3.0:1788941022.622185:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788941022.622196:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+16:22724:x1875839945015168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941022.622232:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941022.622249:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badecc9 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.622307:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.622318:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.622328:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936200, rc 0) 00000100:00100000:3.0:1788941022.622376:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945015168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 182us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941022.622383:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941022.622486:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941022.622505:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.622516:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941022.622580:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015296:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941022.622615:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941022.622649:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f59b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941022.625851:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015296 00000100:00100000:3.0:1788941022.625873:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015296 00000100:00100000:3.0:1788941022.625974:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788941022.625987:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945015296:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941022.626025:0:22721:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941022.626057:0:22721:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941022.626061:0:22721:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788941022.626233:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945015296:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 247us (3615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941022.626242:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788941022.626573:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015296:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941022.626647:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941022.626665:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.626690:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941022.626703:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788941022.626706:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d0065f9800 from 12 10000000:01000000:0.0:1788941022.626709:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788941022.626750:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.626761:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.626772:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941022.626799:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941022.626852:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941022.626894:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f59b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941022.627056:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015424 00000100:00100000:3.0:1788941022.627062:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015424 00000100:00100000:3.0:1788941022.627101:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788941022.627117:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945015424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941022.627138:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941022.627155:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badecd7 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.627180:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 18 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.627193:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 18 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941022.627203:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936400, rc 0) 00000100:00100000:3.0:1788941022.627234:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945015424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941022.627241:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788941022.628092:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941022.628122:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.628135:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941022.628194:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788941022.628245:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941022.628311:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f59b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941022.631089:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015552 00000100:00100000:3.0:1788941022.631108:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015552 00000100:00100000:3.0:1788941022.631202:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788941022.631214:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945015552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941022.631246:0:22721:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941022.631310:0:22721:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941022.631315:0:22721:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:3.0:1788941022.631471:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945015552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 259us (3225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941022.631480:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788941022.631838:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945015552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788941022.631910:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788941022.631922:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941022.631936:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941023.074667:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941023.583304:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00010000:00010000:2.0:1788941024.093044:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941024.603824:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000040:00080000:3.0:1788941024.604778:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788941025.120445:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941025.628572:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 0 seconds 00000100:00080000:2.0:1788941025.952766:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788941025.952773:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788941025.952777:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941025.952789:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff91d039a45000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941025.952823:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005045c00 x1875839945015808/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941025.952842:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941025.952846:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941025.952849:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941025.952852:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941025.952888:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941025.952891:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941025.952893:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941025.952896:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788941025.952930:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945015808:0@lo:38:kworker.0 00000100:00100000:2.0:1788941025.953000:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.953053:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945016064:0@lo:400:kworker.0 00000100:00100000:2.0:1788941025.953087:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.953106:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941025.953112:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945016192:0@lo:400:kworker.0 00000100:00100000:2.0:1788941025.953135:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.953168:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015808 00000100:00100000:2.0:1788941025.953189:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015808 00000100:00100000:2.0:1788941025.953215:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016064 00000100:00100000:2.0:1788941025.953217:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016064 00000100:00100000:2.0:1788941025.953240:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788941025.953247:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3644:x1875839945015808:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788941025.953316:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 781 last 0 00000020:00000080:2.0:1788941025.953353:0:22733:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badece5 00000004:00100000:2.0:1788941025.953379:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788941025.953385:0:22733:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:3.0:1788941025.953738:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945015936:0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.953773:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941025.953806:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788941025.953820:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945015680:0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.953848:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941025.953902:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016192 00000100:00100000:3.0:1788941025.953906:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016192 00000100:00100000:3.0:1788941025.953934:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015936 00000100:00100000:3.0:1788941025.953937:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015936 00000100:00100000:3.0:1788941025.953951:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941025.953958:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945016192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.954006:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945016192:12345-0@lo:400:kworker.0 Request processed in 49us (870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941025.954013:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941025.954028:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941025.954034:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945015936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.954065:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945015936:12345-0@lo:400:kworker.0 Request processed in 31us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941025.954070:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941025.954098:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945015680 00000100:00100000:3.0:1788941025.954102:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945015680 00000100:00100000:3.0:1788941025.954124:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788941025.954130:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+18:3646:x1875839945015680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.954157:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+18:3646:x1875839945015680:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941025.954163:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:3.0:1788941025.954215:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d005047480 x1875839945016192/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941025.954228:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945016192:0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.954296:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945015680:0@lo:400:kworker.0 00010000:00080000:3.0:1788941025.954306:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d005044700 x1875839945015936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941041 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941025.954314:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005044700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945015936:0@lo:400:kworker.0 00000100:00100000:0.0:1788941025.956177:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945016320:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941025.956235:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941025.956488:0:22732:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788941025.956498:0:22732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1788941025.956641:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016320 00000100:00100000:0.0:1788941025.956649:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016320 00000100:00100000:0.0:1788941025.956753:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941025.956762:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839945016064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941025.957161:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945016064:0@lo:400:kworker.0 00000100:00100000:0.0:1788941025.958039:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839945016064:12345-0@lo:400:kworker.0 Request processed in 53us (3735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941025.958049:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941025.958075:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788941025.958095:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945016320:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788941025.958125:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941025.958191:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945016320:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941025.958198:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788941025.967144:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945016320:0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1788941025.982096:0:22733:0:(import.c:65:import_set_state_nolock()) ffff91d02e8d2000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941025.982197:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839945015808:12345-0@lo:38:kworker.0 Request processed in 28948us (29196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941025.982209:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788941025.982324:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788941025.982334:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:2.0:1788941025.982340:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788941025.982342:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d039a45000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788941025.982376:0:3644:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000006a6390a1): req@ffff91d035a51180 x1875839945008512/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941025.982397:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945015808:0@lo:38:kworker.0 00000100:00100000:2.0:1788941025.982462:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.982487:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00508b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788941025.982503:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945008512 00000100:00100000:2.0:1788941025.982509:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945008512 00000100:00100000:2.0:1788941025.982554:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941025.982562:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945008512:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941025.982629:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945008512:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 68us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941025.982636:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941025.982846:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51180 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875839945008512:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788941025.982895:0:22770:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788941025.982935:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875839945016448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941025.982963:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.982987:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d021b4a480 going to sleep for 11 seconds 00000100:00100000:1.0:1788941025.983200:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016448 00000100:00100000:1.0:1788941025.983204:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016448 00000100:00100000:1.0:1788941025.983227:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788941025.983234:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945016448:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788941025.983361:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945016448:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 127us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941025.983378:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788941025.984356:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945016576:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941025.984411:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941025.984458:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016576 00000100:00100000:3.0:1788941025.984463:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016576 00000100:00100000:3.0:1788941025.984486:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788941025.984492:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839945016576:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941025.984520:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941025.984557:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839945016576:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941025.984564:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788941025.984600:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945016576:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941025.985418:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875839945016448:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941025.985511:0:22770:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875839945016704:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941025.985550:0:22770:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941025.985570:0:22770:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00d221540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941025.985585:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016704 00000100:00100000:2.0:1788941025.985589:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016704 00000100:00100000:2.0:1788941025.985617:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941025.985625:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945016704:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788941025.986444:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22770:x1875839945016704:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 816us (889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941025.986453:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941025.986494:0:22770:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22770:1875839945016704:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788941025.986539:0:22770:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941025.996355:0:22770:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788941025.999242:0:22770:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 23, retries 0 00000004:00080000:2.0:1788941025.999254:0:22770:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1788941026.142683:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788941026.897775:0:23731:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788941026.972743:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941011/real 1788941011] req@ffff91d03f8a2680 x1875839945009536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941026.972774:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a2680 x1875839945009536/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941026.972785:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941011/real 1788941011] req@ffff91d03f8a3800 x1875839945009664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941026 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941026.972823:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a3800 x1875839945009664/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941026 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941026.972842:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941026.972856:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941026.972859:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009536:0@lo:8:kworker.0 00000100:00080000:2.0:1788941026.972865:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941026.972870:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941026.972872:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945009664:0@lo:8:kworker.0 00000100:00080000:2.0:1788941026.972991:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941026.972995:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788941026.972997:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941026.973002:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 766 00000100:00080000:2.0:1788941026.973007:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788941026.973015:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d034738000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941026.973032:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005045180 x1875839945017088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941026.973045:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941026.973048:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941026.973050:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941026.973053:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 766 00000100:00080000:2.0:1788941026.973056:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788941026.973059:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941026.973085:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d005046680 x1875839945017216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941026.973127:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941026.973130:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941026.973133:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941026.973136:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788941026.973160:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945016960:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973223:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941026.973278:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788941026.973285:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945016832:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973313:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941026.973339:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945017600:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973365:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941026.973389:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945017344:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973655:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941026.973680:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941026.973686:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945017472:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973709:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941026.973738:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016960 00000100:00100000:2.0:1788941026.973745:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016960 00000100:00100000:2.0:1788941026.973784:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017472 00000100:00100000:2.0:1788941026.973914:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017472 00000100:00100000:2.0:1788941026.973934:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788941026.973942:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839945016960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.973994:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839945016960:12345-0@lo:400:kworker.0 Request processed in 53us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941026.974013:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788941026.974029:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941026.974035:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945017472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941026.974298:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017600 00000100:00100000:3.0:1788941026.974304:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017600 00000100:00100000:3.0:1788941026.974330:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017344 00000100:00100000:3.0:1788941026.974333:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017344 00000100:00100000:3.0:1788941026.974345:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941026.974350:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945017600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941026.974388:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945017600:12345-0@lo:400:kworker.0 Request processed in 38us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941026.974393:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941026.974416:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941026.974421:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945017344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941026.974450:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945017344:12345-0@lo:400:kworker.0 Request processed in 29us (795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941026.974455:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941026.975050:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945017472:12345-0@lo:400:kworker.0 Request processed in 1012us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941026.975058:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941026.975157:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945016832 00000100:00100000:2.0:1788941026.975163:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945016832 00000100:00100000:2.0:1788941026.975202:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788941026.975210:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:3648:x1875839945016832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.975249:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:3648:x1875839945016832:12345-0@lo:400:kworker.0 Request processed in 41us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941026.975271:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788941026.975343:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945017472:0@lo:400:kworker.0 00010000:00080000:2.0:1788941026.975358:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d005046a00 x1875839945017344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941026.975367:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945017344:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.975397:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945017088:0@lo:8:kworker.0 00000400:00000100:2.0:1788941026.978294:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945017088 offset 0 length 520: 4 00000100:00100000:2.0:1788941026.978331:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945017216:0@lo:8:kworker.0 00000400:00000100:2.0:1788941026.978355:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945017216 offset 0 length 520: 4 00000100:00100000:2.0:1788941026.979283:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945016832:0@lo:400:kworker.0 00010000:00080000:2.0:1788941026.979311:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d005047100 x1875839945017600/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941042 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941026.979332:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945017600:0@lo:400:kworker.0 00000100:00100000:2.0:1788941026.979348:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945016960:0@lo:400:kworker.0 00010000:00010000:2.0:1788941027.170146:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788941027.949529:0:23783:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941027.949860:0:23783:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788941028.195307:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941029.212675:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788941029.235967:0:23833:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941029.236288:0:23833:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788941030.054523:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941020/real 1788941020] req@ffff91d03f8a1880 x1875839945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941030.054555:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a1880 x1875839945012096/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941030.054575:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941020/real 1788941020] req@ffff91d03f8a2300 x1875839945011968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941030 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941030.054588:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03f8a2300 x1875839945011968/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941030 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941030.055328:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941030.055523:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941030.055530:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945012096:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788941030.055537:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf079f8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788941030.060272:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.060283:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941030.060286:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.060289:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941030.060307:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.060310:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788941030.060314:0:37:0:(import.c:65:import_set_state_nolock()) ffff91cf079f8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788941030.060322:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 775 00000100:00080000:0.0:1788941030.060329:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788941030.060346:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91cf079f8800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941030.060371:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475dc00 x1875839945018240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788941030.060381:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.060383:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788941030.060384:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788941030.060387:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 775 00000100:00080000:0.0:1788941030.060389:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788941030.060391:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941030.060398:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d03475c380 x1875839945018368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941030.060438:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945017728:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.060519:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941030.060572:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945018496:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.060648:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941030.060676:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941030.060694:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945018112:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.060722:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941030.060754:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945017856:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.060776:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941030.060795:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941030.060801:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945017984:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.060822:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941030.061095:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017728 00000100:00100000:0.0:1788941030.061103:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017728 00000100:00100000:0.0:1788941030.061158:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788941030.061168:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:3648:x1875839945017728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061226:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:3648:x1875839945017728:12345-0@lo:400:kworker.0 Request processed in 60us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.061233:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788941030.061287:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945018496 00000100:00100000:0.0:1788941030.061291:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945018496 00000100:00100000:0.0:1788941030.061316:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017984 00000100:00100000:0.0:1788941030.061319:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017984 00000100:00100000:0.0:1788941030.061334:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941030.061341:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945018496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061373:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945018496:12345-0@lo:400:kworker.0 Request processed in 33us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.061379:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941030.061391:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941030.061397:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945017984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061438:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945017984:12345-0@lo:400:kworker.0 Request processed in 41us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.061444:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941030.061462:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945018112 00000100:00100000:0.0:1788941030.061465:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945018112 00000100:00100000:0.0:1788941030.061487:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945017856 00000100:00100000:0.0:1788941030.061490:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945017856 00000100:00100000:0.0:1788941030.061502:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941030.061514:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945018112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061545:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945018112:12345-0@lo:400:kworker.0 Request processed in 32us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.061551:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941030.061562:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788941030.061569:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839945017856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061595:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3645:x1875839945017856:12345-0@lo:400:kworker.0 Request processed in 28us (819us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.061820:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788941030.061944:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475f100 x1875839945017984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941030.061958:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945017984:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.061969:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945017856:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.062004:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945018112:0@lo:400:kworker.0 00000100:00100000:0.0:1788941030.062012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945017728:0@lo:400:kworker.0 00010000:00080000:0.0:1788941030.062024:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03475fb80 x1875839945018496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941030.062054:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945018496:0@lo:400:kworker.0 00000100:00080000:2.0:1788941030.062294:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788941030.062302:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945011968:0@lo:8:llog_process_th.0 00000100:00100000:2.0:1788941030.062324:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945018240:0@lo:8:kworker.0 00000400:00000100:2.0:1788941030.062364:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945018240 offset 0 length 520: 4 00000100:00100000:2.0:1788941030.062387:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945018368:0@lo:8:kworker.0 00000400:00000100:2.0:1788941030.062410:0:3644:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875839945018368 offset 0 length 520: 4 00000100:00080000:0.0:1788941030.062672:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.062677:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788941030.062680:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788941030.062690:0:37:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788941030.240939:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788941030.540977:0:23881:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe835d0750 20000000:00000080:3.0:1788941030.540997:0:23881:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d005bb3400 uarg=0000000000000000 20000000:01000000:3.0:1788941030.541062:0:23881:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788941030.541070:0:23881:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788941030.541074:0:23881:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788941030.542816:0:23882:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1788941030.542932:0:23881:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788941030.550437:0:23881:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788941030.550476:0:23881:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550499:0:23881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550508:0:23881:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550516:0:23881:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550564:0:23881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550583:0:23881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941030.550599:0:23881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23881:1875839945018624:0@lo:104: 00000100:00100000:2.0:1788941030.550680:0:23881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788941030.550746:0:23881:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.550755:0:23881:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941030.550763:0:23881:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23881:1875839945018752:0@lo:104: 00000100:00100000:2.0:1788941030.550802:0:23881:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941030.550823:0:23881:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d039a4a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788941030.551144:0:23482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945018624 00000100:00100000:0.0:1788941030.551154:0:23482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945018624 00000100:00100000:0.0:1788941030.551224:0:23482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945018752 00000100:00100000:0.0:1788941030.551228:0:23482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945018752 00000100:00100000:0.0:1788941030.551246:0:23482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788941030.551284:0:23482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66773969-0b9c-4025-866a-db20e971736d+4:23881:x1875839945018624:12345-0@lo:104: 00010000:00010000:0.0:1788941030.551300:0:23482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551361:0:23482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788941030.551367:0:23482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66773969-0b9c-4025-866a-db20e971736d+4:23881:x1875839945018624:12345-0@lo:104: Request processed in 114us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.551374:0:23482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788941030.551391:0:23482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941030.551397:0:23482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66773969-0b9c-4025-866a-db20e971736d+3:23881:x1875839945018752:12345-0@lo:104: 00010000:00010000:0.0:1788941030.551404:0:23482:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551438:0:23482:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788941030.551443:0:23482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:66773969-0b9c-4025-866a-db20e971736d+3:23881:x1875839945018752:12345-0@lo:104: Request processed in 48us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941030.551458:0:23482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788941030.551475:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941030.551481:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551489:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788941030.551494:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551502:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941030.551510:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941030.551517:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788941030.551549:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551555:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788941030.551574:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551581:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badec91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badec98 expref: -99 pid: 23460 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551595:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941030.551598:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551612:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:0.0:1788941030.551615:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551621:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788941030.551627:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941030.551632:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788941030.551644:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.551650:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788941030.552012:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941030.552791:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945018880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788941030.552842:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941030.552890:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945018880 00000100:00100000:3.0:1788941030.552899:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945018880 00010000:00010000:3.0:1788941030.552931:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 18 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941030.552972:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941030.552980:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+18:3645:x1875839945018880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788941030.552993:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941030.552998:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 18 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941030.553023:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 18 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941030.553060:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941030.553098:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+18:3645:x1875839945018880:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941030.553106:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788941030.553147:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945018880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941030.553604:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c800/0x9c34acc08badec98 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badec91 expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941030.553614:0:23881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23881:1875839945018624:0@lo:104: 00000100:00100000:2.0:1788941030.553621:0:23881:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23881:1875839945018752:0@lo:104: 00010000:00010000:2.0:1788941030.553636:0:23881:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941030.553908:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945019008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941030.553944:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788941030.553946:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.553959:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d800/0x9c34acc08badeb8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeb95 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941030.553978:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941030.553981:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941030.553983:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941030.554027:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019008 00000100:00100000:1.0:1788941030.554033:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019008 00010000:00010000:1.0:1788941030.554069:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941030.554102:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941030.554110:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+17:3646:x1875839945019008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788941030.554119:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941030.554124:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554134:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554146:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c000/0x9c34acc08badeb95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badeb8e expref: 17 pid: 22722 timeout: 885 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554158:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554167:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554181:0:22712:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554188:0:22712:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554210:0:22712:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554217:0:22712:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554224:0:22712:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941030.554228:0:22712:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554237:0:22712:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554281:0:22712:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941030.554290:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941030.554321:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+16:3646:x1875839945019008:12345-0@lo:103:ldlm_bl.0 Request processed in 213us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941030.554326:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941030.554626:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945019008:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941030.554699:0:23881:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.554708:0:23881:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941030.554714:0:23881:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badecec lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23881 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941031.067535:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941031.067559:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945019136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941031.067647:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941031.068715:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019136 00000100:00100000:3.0:1788941031.068726:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019136 00000100:00100000:3.0:1788941031.068792:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941031.068802:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945019136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941031.068839:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941031.068900:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945019136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 99us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941031.068907:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788941031.069085:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945019136:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941031.073652:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945019264:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941031.073735:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941031.073894:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019264 00000100:00100000:1.0:1788941031.073903:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019264 00000100:00100000:1.0:1788941031.073960:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788941031.073982:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839945019264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941031.074016:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941031.074084:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3648:x1875839945019264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941031.074091:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788941031.074317:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945019264:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788941031.260225:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788941031.583464:0:23461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:0.0:1788941031.902293:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788941031.902301:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03593f000 from 13 10000000:01000000:0.0:1788941031.902306:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788941031.902356:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.902375:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.902387:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941031.902415:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.902490:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941031.902555:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0069999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941031.902649:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019392 00000100:00100000:2.0:1788941031.902665:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019392 00000100:00100000:2.0:1788941031.902726:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788941031.902737:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+16:22724:x1875839945019392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941031.902752:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941031.902769:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badecf3 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.902799:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.902811:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 17 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.902821:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0e00, rc 0) 00000100:00100000:2.0:1788941031.902862:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941031.902869:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788941031.903891:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941031.903915:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.903926:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941031.903999:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.904047:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941031.904073:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0069999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941031.904141:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019520 00000100:00100000:2.0:1788941031.904146:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019520 00000100:00100000:2.0:1788941031.904182:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788941031.904189:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941031.904317:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 129us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941031.904325:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788941031.904644:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.904694:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.904725:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941031.904753:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0069999c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941031.904789:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019648 00000100:00100000:2.0:1788941031.904793:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019648 00000100:00100000:2.0:1788941031.904820:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788941031.904827:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788941031.904906:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941031.904913:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788941031.904986:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788941031.906321:0:23941:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788941031.906528:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788941031.906552:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941031.906562:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.906573:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941031.906583:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788941031.906586:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d0065f9800 from 13 10000000:01000000:2.0:1788941031.906588:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788941031.906614:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.906621:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941031.906631:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941031.906648:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941031.906691:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941031.906716:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00d221e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941031.906757:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019776 00000100:00100000:0.0:1788941031.906763:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019776 00000100:00100000:0.0:1788941031.906799:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788941031.906806:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+17:22724:x1875839945019776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941031.906817:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941031.906828:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded01 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.906848:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded01 expref: 18 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.906859:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded01 expref: 18 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.906866:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d800, rc 0) 00000100:00100000:0.0:1788941031.906902:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945019776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941031.906908:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788941031.906946:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941031.906957:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941031.906966:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941031.907007:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.907039:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941031.907053:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941031.907072:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945019904 00000100:00100000:0.0:1788941031.907075:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945019904 00000100:00100000:0.0:1788941031.907097:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788941031.907104:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945019904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.907210:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945019904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941031.907217:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788941031.907246:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945019904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.907295:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945020032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.907333:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941031.907346:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941031.907356:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020032 00000100:00100000:0.0:1788941031.907360:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020032 00000100:00100000:0.0:1788941031.907381:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788941031.907387:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945020032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941031.908968:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:22724:x1875839945020032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1576us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941031.908979:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788941031.915769:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945020032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788941031.920649:0:23942:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788941031.921131:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788941031.921171:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788941031.921184:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941031.921198:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941032.286626:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941032.860913:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941033.309873:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941034.332639:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941034.844198:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788941035.166327:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941035.166335:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941035.166338:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941035.166342:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941035.166370:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941035.166374:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941035.166377:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941035.166380:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941035.166424:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945020160:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.166531:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.166581:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945020672:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.166614:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.166649:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941035.166655:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945020288:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.166683:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.166717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.166744:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.166765:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941035.166770:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945020544:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.166793:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941035.166843:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020672 00000100:00100000:1.0:1788941035.166853:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020672 00000100:00100000:1.0:1788941035.166916:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020416 00000100:00100000:1.0:1788941035.166919:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020416 00000100:00100000:1.0:1788941035.166940:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941035.166950:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945020672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.167030:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945020672:12345-0@lo:400:kworker.0 Request processed in 80us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941035.167038:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941035.167057:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941035.167063:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945020416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.167095:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945020416:12345-0@lo:400:kworker.0 Request processed in 32us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941035.167101:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941035.167125:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020288 00000100:00100000:1.0:1788941035.167128:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020288 00000100:00100000:1.0:1788941035.167155:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020544 00000100:00100000:1.0:1788941035.167158:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020544 00000100:00100000:1.0:1788941035.167171:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788941035.167177:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945020288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.167212:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945020288:12345-0@lo:400:kworker.0 Request processed in 35us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941035.167219:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788941035.167231:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788941035.167237:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945020544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.167292:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945020544:12345-0@lo:400:kworker.0 Request processed in 55us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941035.167309:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788941035.167366:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945020544:0@lo:400:kworker.0 00010000:00080000:1.0:1788941035.167383:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03f8a2300 x1875839945020416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941035.167393:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945020416:0@lo:400:kworker.0 00000100:00100000:1.0:1788941035.167432:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945020288:0@lo:400:kworker.0 00010000:00080000:1.0:1788941035.167444:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d03f8a3800 x1875839945020672/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941035.167453:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945020672:0@lo:400:kworker.0 00000100:00100000:2.0:1788941035.167598:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020160 00000100:00100000:2.0:1788941035.167603:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020160 00000100:00100000:2.0:1788941035.167647:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788941035.167655:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:3645:x1875839945020160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941035.167700:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+18:3645:x1875839945020160:12345-0@lo:400:kworker.0 Request processed in 47us (1170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941035.167707:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788941035.167750:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945020160:0@lo:400:kworker.0 00010000:00010000:3.0:1788941035.379297:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941036.187519:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941036.187551:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945020800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941036.187657:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941036.188016:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020800 00000100:00100000:1.0:1788941036.188029:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020800 00000100:00100000:1.0:1788941036.188115:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788941036.188129:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945020800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941036.188196:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941036.191454:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788941036.191491:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945020928:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941036.191758:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945020800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3627us (4096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941036.191771:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941036.191896:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945020800:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941036.192111:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941036.195054:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945020928 00000100:00100000:2.0:1788941036.195076:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945020928 00000100:00100000:2.0:1788941036.195148:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941036.195158:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945020928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788941036.195205:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941036.199161:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945020928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3988us (7036us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941036.199181:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941036.199608:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945020928:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788941036.379625:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941037.405367:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941038.428929:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788941038.477363:0:24230:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788941038.477369:0:24230:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788941038.477370:0:24230:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788941038.477506:0:24230:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91d03ec16800 00000020:01000004:3.0:1788941038.477529:0:24230:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788941038.478491:0:24230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788941038.478517:0:24230:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91d035a899d8) 00000020:00000080:3.0:1788941038.478664:0:24230:0:(obd_config.c:786:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788941038.642863:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788941038.654975:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788941038.656078:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788941038.656442:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788941038.656950:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788941038.657214:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788941038.657641:0:24230:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:01000000:3.0:1788941038.660729:0:24230:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788941038.661068:0:24230:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788941038.661087:0:24230:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788941038.661103:0:24230:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08baded16 00000020:01000004:3.0:1788941038.661113:0:24230:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788941038.661142:0:24230:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788941038.661147:0:24230:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788941038.661154:0:24230:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788941038.661160:0:24230:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788941038.661175:0:24230:0:(genops.c:415:class_newdev()) Allocate new device OSS (ffff91d035a8cd88) 00000020:00000080:3.0:1788941038.661188:0:24230:0:(obd_config.c:786:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788941038.667024:0:24230:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788941038.667475:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788941038.667486:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788941038.668598:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788941038.668608:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788941038.669058:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788941038.669065:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788941038.672913:0:24230:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941038.673147:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788941038.673153:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788941038.687798:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788941038.687821:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788941038.737043:0:24230:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941038.738056:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788941038.738067:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788941038.745503:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788941038.745529:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788941038.746978:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788941038.746990:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788941038.752350:0:24230:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788941038.753144:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788941038.754190:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788941038.758588:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788941038.758602:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788941038.826020:0:24230:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788941038.827050:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788941038.827059:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788941038.829791:0:24230:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788941038.829808:0:24230:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788941038.831765:0:24230:0:(obd_config.c:900:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788941038.831795:0:24230:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1788941038.831807:0:24230:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788941038.857850:0:24230:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788941038.857911:0:24230:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.125@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788941038.857916:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788941038.857918:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941038.857919:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941038.857920:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941038.857921:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941038.857923:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941038.857924:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941038.857926:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941038.857927:0:24230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941038.857930:0:24230:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788941038.857932:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788941038.857934:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941038.857935:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941038.857936:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941038.857937:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941038.857938:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941038.857939:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941038.857940:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941038.857941:0:24230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941038.857986:0:24230:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788941038.858007:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021056:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788941038.858079:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.858130:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.858192:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021056 00000100:00100000:0.0:1788941038.858200:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021056 00000100:00100000:0.0:1788941038.858295:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788941038.858306:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+18:24230:x1875839945021056:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941038.858335:0:22722:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788941038.858338:0:22722:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788941038.858342:0:22722:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788941038.858712:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+18:24230:x1875839945021056:12345-0@lo:253:mount.lustre.0 Request processed in 407us (632us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.858720:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788941038.858832:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021056:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941038.858843:0:24230:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788941038.858845:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941038.858846:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788941038.858847:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941038.858855:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941038.858856:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941038.858857:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941038.858858:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941038.858860:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941038.858861:0:24230:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941038.858879:0:24230:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d03ec16800 from lustre-OST0000 10000000:01000000:3.0:1788941038.858906:0:24230:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788941038.858909:0:24230:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788941038.858917:0:24230:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d03ec599d8 local copy 00010000:00010000:3.0:1788941038.858926:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941038.859029:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021184:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941038.859058:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.859080:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.859133:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021184 00000100:00100000:0.0:1788941038.859137:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021184 00000100:00100000:0.0:1788941038.859175:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788941038.859183:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:24230:x1875839945021184:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941038.859242:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:24230:x1875839945021184:12345-0@lo:501:mount.lustre.0 Request processed in 61us (183us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788941038.859249:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788941038.859648:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021184:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788941038.859662:0:24230:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788941038.859681:0:24230:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788941038.859687:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.859696:0:24230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941038.859722:0:24230:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d03ec16800 10000000:01000000:3.0:1788941038.859727:0:24230:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788941038.859732:0:24230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788941038.859734:0:24230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941038.859738:0:24230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1788941038.859741:0:24230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788941038.859770:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.859779:0:24230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.859789:0:24230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941038.859803:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021312:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941038.859832:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.859850:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.859901:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021312 00000100:00100000:0.0:1788941038.859906:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021312 00000100:00100000:0.0:1788941038.859942:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788941038.859949:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+18:24230:x1875839945021312:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941038.859968:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941038.859980:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584d600/0x9c34acc08baded2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded24 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.860007:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584d600/0x9c34acc08baded2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded24 expref: 19 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.860028:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584d600/0x9c34acc08baded2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded24 expref: 19 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.860037:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d600, rc 0) 00000100:00100000:0.0:1788941038.860074:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021312:12345-0@lo:101:mount.lustre.0 Request processed in 125us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.860080:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941038.860188:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021312:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941038.860201:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded2b expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.860210:0:24230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08baded2b expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941038.861619:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:3.0:1788941038.862142:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941038.864928:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:3.0:1788941038.864999:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:3.0:1788941038.865021:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:3.0:1788941038.865036:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:3.0:1788941038.865049:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:3.0:1788941038.865061:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:3.0:1788941038.865077:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:3.0:1788941038.865091:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:3.0:1788941038.865103:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:3.0:1788941038.865127:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:3.0:1788941038.865139:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:3.0:1788941038.865152:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:3.0:1788941038.865179:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:3.0:1788941038.865184:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:3.0:1788941038.865630:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941038.865707:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.865754:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.865829:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021440 00000100:00100000:0.0:1788941038.865838:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021440 00000100:00100000:0.0:1788941038.865927:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788941038.865938:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021440:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788941038.866102:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021440:12345-0@lo:501:mount.lustre.0 Request processed in 166us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.866110:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788941038.866178:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021440:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941038.866208:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021568:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941038.866281:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.866914:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02e9fa9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.867002:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021568 00000100:00100000:1.0:1788941038.867010:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021568 00000100:00100000:1.0:1788941038.867049:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788941038.867059:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021568:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941038.868140:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021568:12345-0@lo:503:mount.lustre.0 Request processed in 1079us (1854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.868150:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788941038.868293:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021568:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941038.868873:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941038.868954:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021696:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941038.869019:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.869060:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06374000 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.869126:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021696 00000100:00100000:0.0:1788941038.869133:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021696 00000100:00100000:0.0:1788941038.869179:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788941038.869188:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021696:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941038.869822:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021696:12345-0@lo:502:mount.lustre.0 Request processed in 634us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.869830:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788941038.869931:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021696:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941038.870129:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788941038.870172:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:3.0:1788941038.870191:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:3.0:1788941038.870205:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:3.0:1788941038.870218:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:3.0:1788941038.870231:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:3.0:1788941038.870284:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:3.0:1788941038.870301:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:3.0:1788941038.870324:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:3.0:1788941038.870347:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:3.0:1788941038.870663:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:3.0:1788941038.870688:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:3.0:1788941038.870720:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941038.870764:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.870800:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06374000 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.870853:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021824 00000100:00100000:1.0:1788941038.870859:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021824 00000100:00100000:1.0:1788941038.870900:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788941038.870908:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021824:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941038.871016:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021824:12345-0@lo:502:mount.lustre.0 Request processed in 109us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.871024:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788941038.871159:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941038.871199:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:3.0:1788941038.871206:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788941038.872066:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788941038.872073:0:24247:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788941038.872080:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788941038.872082:0:24247:0:(obd_config.c:1662:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788941038.872088:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788941038.872102:0:24247:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0000 (ffff91d004644d88) 00000020:00000080:1.0:1788941038.872125:0:24247:0:(obd_config.c:786:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788941038.872132:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788941038.872212:0:24247:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03ec16800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788941038.872222:0:24247:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788941038.872229:0:24247:0:(genops.c:1393:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x9c34acc08baded39 00010000:00010000:3.0:1788941038.884876:0:24247:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1788941038.885753:0:24247:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1788941038.887213:0:24247:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:0.0:1788941038.889573:0:24247:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788941038.889588:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.889595:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889598:0:24247:0:(obd_config.c:1662:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788941038.889602:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788941038.889610:0:24247:0:(obd_config.c:2001:class_config_llog_handler()) SKIP #25 00000020:01000000:0.0:1788941038.889611:0:24247:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941038.889614:0:24247:0:(obd_config.c:2027:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788941038.889616:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788941038.889618:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889620:0:24247:0:(obd_config.c:1662:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788941038.889622:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.889625:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889626:0:24247:0:(obd_config.c:1662:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788941038.889629:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788941038.889631:0:24247:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788941038.889634:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.889636:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889637:0:24247:0:(obd_config.c:1662:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788941038.889639:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.889641:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889642:0:24247:0:(obd_config.c:1662:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788941038.889645:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788941038.889673:0:24247:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.889675:0:24247:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.889676:0:24247:0:(obd_config.c:1662:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788941038.889680:0:24247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:3.0:1788941038.889877:0:24230:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788941038.889908:0:24230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788941038.889933:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded2b expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.889945:0:24230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937e00/0x9c34acc08baded24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded2b expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941038.889954:0:24230:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03ec16800 from 1 10000000:01000000:3.0:1788941038.889965:0:24230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788941038.890002:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.890011:0:24230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941038.890022:0:24230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941038.890054:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021952:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941038.890124:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941038.890168:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06374cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.890450:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945021952 00000100:00100000:0.0:1788941038.890458:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945021952 00000100:00100000:0.0:1788941038.890501:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788941038.890511:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945021952:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941038.890576:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941038.890589:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded40 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.890617:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded40 expref: 20 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.890629:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded40 expref: 20 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941038.890645:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ca00, rc 0) 00000100:00100000:0.0:1788941038.890698:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945021952:12345-0@lo:101:mount.lustre.0 Request processed in 189us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.890706:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788941038.890845:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945021952:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941038.890863:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.890872:0:24230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941038.893642:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1788941038.893913:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941038.894127:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:2.0:1788941038.894150:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:2.0:1788941038.894162:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:2.0:1788941038.894174:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:2.0:1788941038.894187:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:2.0:1788941038.894200:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:2.0:1788941038.894212:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:2.0:1788941038.894223:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:2.0:1788941038.894235:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:2.0:1788941038.894481:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:2.0:1788941038.894510:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:2.0:1788941038.894595:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:2.0:1788941038.894602:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:2.0:1788941038.894675:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941038.894737:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.894821:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788941038.897561:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022080 00000100:00100000:3.0:1788941038.897578:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022080 00000100:00100000:3.0:1788941038.897642:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788941038.897652:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022080:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941038.897825:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022080:12345-0@lo:501:mount.lustre.0 Request processed in 174us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941038.897834:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788941038.898015:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022080:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941038.898063:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022208:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941038.898116:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.898152:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.898245:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022208 00000100:00100000:1.0:1788941038.898251:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022208 00000100:00100000:1.0:1788941038.898297:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788941038.898304:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022208:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941038.898565:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022208:12345-0@lo:503:mount.lustre.0 Request processed in 262us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.898573:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788941038.898653:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022208:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941038.899035:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941038.899102:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022336:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941038.899138:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.899172:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.900031:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022336 00000100:00100000:1.0:1788941038.900041:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022336 00000100:00100000:1.0:1788941038.900078:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788941038.900085:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022336:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941038.900186:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022336:12345-0@lo:502:mount.lustre.0 Request processed in 101us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.900194:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788941038.900446:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022336:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941038.900644:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788941038.900673:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1788941038.900686:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1788941038.900699:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1788941038.900713:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1788941038.900724:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1788941038.900736:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1788941038.900748:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1788941038.900760:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1788941038.900772:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:2.0:1788941038.900797:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:2.0:1788941038.900823:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022464:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941038.900864:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.900898:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.901652:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022464 00000100:00100000:1.0:1788941038.901662:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022464 00000100:00100000:1.0:1788941038.901698:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788941038.901705:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022464:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941038.903904:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022464:12345-0@lo:502:mount.lustre.0 Request processed in 2190us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.903918:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788941038.910864:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022464:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941038.910984:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1788941038.910997:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788941038.912172:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.912184:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.912186:0:24251:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788941038.912192:0:24251:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03ec16800 00000020:00000080:0.0:1788941038.912194:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941038.912202:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.912205:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.912206:0:24251:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788941038.912208:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.912211:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.912212:0:24251:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788941038.912216:0:24251:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d03ec16800 00000020:00000080:0.0:1788941038.912218:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941038.912664:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.912669:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.912670:0:24251:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788941038.912673:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.912676:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.912677:0:24251:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788941038.912681:0:24251:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03ec16800 00000020:00000080:0.0:1788941038.912683:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941038.914648:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.914660:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.914663:0:24251:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788941038.914667:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788941038.914671:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.914680:0:24251:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788941038.914686:0:24251:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d03ec16800 00000020:00000080:0.0:1788941038.914688:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788941038.914743:0:24251:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788941038.914746:0:24251:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941038.914747:0:24251:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788941038.914750:0:24251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1788941038.918852:0:24230:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788941038.918910:0:24230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941038.918938:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.918952:0:24230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941038.919026:0:24230:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788941038.919030:0:24230:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d03ec16800 10000000:01000000:2.0:1788941038.919033:0:24230:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d03ec16800 10000000:01000000:2.0:1788941038.919037:0:24230:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788941038.919043:0:24230:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91d03ec16800 from 1 10000000:01000000:2.0:1788941038.919046:0:24230:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788941038.919082:0:24230:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919090:0:24230:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919101:0:24230:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941038.919176:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788941038.919246:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.919319:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022592 00000100:00100000:2.0:1788941038.919329:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022592 00000100:00100000:2.0:1788941038.919628:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788941038.919639:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:24230:x1875839945022592:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941038.919653:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941038.919666:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1600/0x9c34acc08baded55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded4e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919692:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1600/0x9c34acc08baded55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded4e expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919703:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1600/0x9c34acc08baded55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded4e expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919711:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1600, rc 0) 00000100:00100000:2.0:1788941038.919747:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022592:12345-0@lo:101:mount.lustre.0 Request processed in 111us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941038.919753:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788941038.919798:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06900 going to sleep for 11 seconds 00000100:00100000:2.0:1788941038.919821:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788941038.919835:0:24230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded55 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941038.919844:0:24230:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08baded55 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788941038.948186:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:2.0:1788941038.948538:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941038.948767:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788941038.948791:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:2.0:1788941038.948806:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:2.0:1788941038.948820:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:2.0:1788941038.948833:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:2.0:1788941038.948847:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:2.0:1788941038.948859:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:2.0:1788941038.948872:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:2.0:1788941038.948886:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788941038.948900:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:2.0:1788941038.948912:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:2.0:1788941038.948938:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:2.0:1788941038.948955:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:2.0:1788941038.948982:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:2.0:1788941038.948996:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:2.0:1788941038.949009:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:2.0:1788941038.949022:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:2.0:1788941038.949034:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:2.0:1788941038.949048:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:2.0:1788941038.949061:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:2.0:1788941038.949072:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:2.0:1788941038.949084:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:2.0:1788941038.949096:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:2.0:1788941038.949108:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:2.0:1788941038.949119:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:2.0:1788941038.949130:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:2.0:1788941038.949142:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:2.0:1788941038.949167:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:2.0:1788941038.949181:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:2.0:1788941038.949204:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:2.0:1788941038.949219:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:2.0:1788941038.949232:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:2.0:1788941038.949244:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:2.0:1788941038.949292:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:2.0:1788941038.949310:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:2.0:1788941038.949325:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:2.0:1788941038.949338:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:2.0:1788941038.949352:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:2.0:1788941038.949363:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:2.0:1788941038.949376:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:2.0:1788941038.949388:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:2.0:1788941038.949400:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:2.0:1788941038.949412:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:2.0:1788941038.949439:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:2.0:1788941038.949455:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:2.0:1788941038.949469:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:2.0:1788941038.949481:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:2.0:1788941038.949495:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:2.0:1788941038.949606:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:2.0:1788941038.949628:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:2.0:1788941038.949646:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:2.0:1788941038.949652:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:2.0:1788941038.949744:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941038.949814:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.949869:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.950046:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022720 00000100:00100000:1.0:1788941038.950056:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022720 00000100:00100000:1.0:1788941038.950107:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788941038.950116:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941038.950237:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022720:12345-0@lo:501:mount.lustre.0 Request processed in 121us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.950245:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788941038.952586:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941038.952645:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941038.952722:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.952765:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.952910:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022848 00000100:00100000:0.0:1788941038.952918:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022848 00000100:00100000:0.0:1788941038.952977:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788941038.952985:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022848:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941038.953104:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022848:12345-0@lo:503:mount.lustre.0 Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.953111:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788941038.954039:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788941038.954500:0:24230:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788941038.954713:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941038.954776:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.954853:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941038.956969:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945022976 00000100:00100000:0.0:1788941038.956982:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945022976 00000100:00100000:0.0:1788941038.957050:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788941038.957061:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022976:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941038.957472:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945022976:12345-0@lo:502:mount.lustre.0 Request processed in 412us (2695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.957481:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788941038.966329:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945022976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941038.966676:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788941038.966707:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:2.0:1788941038.966720:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:2.0:1788941038.966735:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:2.0:1788941038.966747:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:2.0:1788941038.966774:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:2.0:1788941038.966787:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:2.0:1788941038.966798:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:2.0:1788941038.966810:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788941038.966822:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:2.0:1788941038.966834:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:2.0:1788941038.966846:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:2.0:1788941038.966859:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:2.0:1788941038.966871:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:2.0:1788941038.966888:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:2.0:1788941038.966902:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:2.0:1788941038.966914:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:2.0:1788941038.966927:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:2.0:1788941038.966940:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:2.0:1788941038.966954:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:2.0:1788941038.966981:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:2.0:1788941038.967010:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:2.0:1788941038.967023:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:2.0:1788941038.967034:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:2.0:1788941038.967055:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:2.0:1788941038.967068:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:2.0:1788941038.967081:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:2.0:1788941038.967092:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:2.0:1788941038.967101:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:2.0:1788941038.967110:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:2.0:1788941038.967119:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:2.0:1788941038.967131:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:2.0:1788941038.967142:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:2.0:1788941038.967151:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:2.0:1788941038.967160:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:2.0:1788941038.967170:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:2.0:1788941038.967179:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:2.0:1788941038.967200:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:2.0:1788941038.967211:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:2.0:1788941038.967220:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:2.0:1788941038.967232:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:2.0:1788941038.967243:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:2.0:1788941038.967288:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:2.0:1788941038.967306:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:2.0:1788941038.967320:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:2.0:1788941038.967331:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:2.0:1788941038.967342:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:2.0:1788941038.967353:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:2.0:1788941038.967401:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945023104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941038.967473:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.967704:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.967773:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023104 00000100:00100000:1.0:1788941038.967781:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023104 00000100:00100000:1.0:1788941038.967830:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788941038.967839:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945023104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941038.969646:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945023104:12345-0@lo:502:mount.lustre.0 Request processed in 1799us (2164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.969674:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788941038.977137:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945023104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941038.977389:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1788941038.977417:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1788941038.977457:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945023232:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941038.977549:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941038.977596:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941038.978094:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023232 00000100:00100000:1.0:1788941038.978104:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023232 00000100:00100000:1.0:1788941038.978164:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788941038.978173:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945023232:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941038.978305:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945023232:12345-0@lo:502:mount.lustre.0 Request processed in 132us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.978313:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788941038.978448:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945023232:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941038.978498:0:24230:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1788941038.978508:0:24230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788941038.982799:0:24257:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788941038.982817:0:24257:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91d017e599d8) 00000020:00000080:0.0:1788941038.982840:0:24257:0:(obd_config.c:786:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:0.0:1788941038.982942:0:24257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03ec16800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788941038.982947:0:24257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d03ec16800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788941038.982949:0:24257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03ec16800 3 00010000:00080000:0.0:1788941038.982992:0:24257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf0606c800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788941038.990005:0:24257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1788941038.990242:0:24257:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1788941038.990320:0:24257:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788941038.990333:0:24257:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x9c34acc08baded63 00000100:00080000:1.0:1788941038.990342:0:24257:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941038.990348:0:24257:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91cf0606c800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941038.990382:0:24257:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d0065d3800 x1875839945023360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941038.990405:0:24257:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788941038.990569:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945023360:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788941038.990645:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941038.990792:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023360 00000100:00100000:1.0:1788941038.990800:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023360 00000100:00100000:1.0:1788941038.990834:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941038.990842:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3644:x1875839945023360:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941038.990864:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:1.0:1788941038.990929:0:22727:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x9c34acc08baded6a 00000004:00100000:1.0:1788941038.990945:0:22727:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941038.990985:0:22727:0:(import.c:65:import_set_state_nolock()) ffff91cf08c3d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941038.991037:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3644:x1875839945023360:12345-0@lo:38:llog_process_th.0 Request processed in 195us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.991050:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788941038.991088:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d0065d3800 x1875839945023360/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941048 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941038.991098:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941038.991105:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788941038.991111:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788941038.991115:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788941038.991117:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf0606c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788941038.991122:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3644:1875839945023360:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788941038.991694:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00080000:3.0:1788941038.991747:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941038.991753:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941038.991756:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941038.991759:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941038.991808:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941038.991811:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941038.991814:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941038.991816:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788941038.991854:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945023616:0@lo:400:kworker.0 00000100:00100000:0.0:1788941038.991891:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941038.991913:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941038.991918:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945023744:0@lo:400:kworker.0 00000100:00100000:0.0:1788941038.991942:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941038.992315:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023616 00000100:00100000:0.0:1788941038.992321:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023616 00000100:00100000:0.0:1788941038.992356:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941038.992363:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945023616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941038.992405:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945023616:12345-0@lo:400:kworker.0 Request processed in 43us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.992411:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788941038.992462:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d035a53b80 x1875839945023616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941038.992474:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945023616:0@lo:400:kworker.0 00000100:00100000:0.0:1788941038.993628:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023744 00000100:00100000:0.0:1788941038.993636:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023744 00000100:00100000:0.0:1788941038.993675:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788941038.993683:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945023744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941038.993740:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945023744:12345-0@lo:400:kworker.0 Request processed in 59us (1798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941038.993747:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788941038.993781:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945023744:0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.994622:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945023872:0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.994668:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941038.994739:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945023488:0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.994766:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941038.994804:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023488 00000100:00100000:1.0:1788941038.994809:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023488 00000100:00100000:1.0:1788941038.994838:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788941038.994845:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945023488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.994882:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945023488:12345-0@lo:400:kworker.0 Request processed in 38us (115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.994888:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788941038.997659:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945023872 00000100:00100000:1.0:1788941038.997672:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945023872 00000100:00100000:1.0:1788941038.997724:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941038.997733:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945023872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.997817:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945023872:12345-0@lo:400:kworker.0 Request processed in 84us (3148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941038.997825:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788941038.998140:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d035a53100 x1875839945023872/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941054 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941038.998156:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945023872:0@lo:400:kworker.0 00000100:00100000:1.0:1788941038.998169:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945023488:0@lo:400:kworker.0 00000020:01000004:1.0:1788941038.998317:0:24257:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1788941038.998333:0:24257:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff91d03560cd88) 00000020:00000080:1.0:1788941038.998358:0:24257:0:(obd_config.c:786:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:1.0:1788941038.998502:0:24257:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d03ec16800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788941038.998508:0:24257:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d03ec16800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1788941038.998510:0:24257:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91d03ec16800 3 00010000:00080000:1.0:1788941038.998653:0:24257:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf08c3f000@lustre-MDT0001-lwp-OST0000: add connection 192.168.202.125@tcp at head 00010000:00010000:1.0:1788941039.000423:0:24257:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:1.0:1788941039.001159:0:24257:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:1.0:1788941039.001203:0:24257:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788941039.001215:0:24257:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x9c34acc08baded78 00000100:00080000:1.0:1788941039.001224:0:24257:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941039.001230:0:24257:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff91cf08c3f000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941039.001342:0:24257:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d0065d1180 x1875839945024000/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788941039.001399:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839945024000:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788941039.001467:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788941039.001581:0:24257:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:1.0:1788941039.001782:0:24257:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1788941039.002015:0:24230:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788941039.002048:0:24230:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788941039.002069:0:24230:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded55 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.002081:0:24230:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1000/0x9c34acc08baded4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded55 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788941039.002124:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788941039.002126:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788941039.002128:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941039.002129:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941039.002130:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941039.002132:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941039.002134:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941039.002135:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941039.002137:0:24230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788941039.002141:0:24230:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788941039.002143:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788941039.002144:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788941039.002146:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941039.002147:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941039.002148:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941039.002149:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941039.002151:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941039.002152:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941039.002153:0:24230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788941039.002168:0:24230:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788941039.002180:0:24230:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945024128:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788941039.002225:0:24230:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941039.002246:0:24230:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0310cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941039.002415:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024128 00000100:00100000:1.0:1788941039.002423:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024128 00000100:00100000:1.0:1788941039.002474:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788941039.002484:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:24230:x1875839945024128:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788941039.002506:0:22721:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788941039.002616:0:22721:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788941039.003989:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024000 00000100:00100000:1.0:1788941039.003999:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024000 00000100:00100000:1.0:1788941039.004033:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941039.004040:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3644:x1875839945024000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941039.004068:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 794 last 0 00000020:00000080:1.0:1788941039.004105:0:22729:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x9c34acc08baded7f 00000004:00100000:1.0:1788941039.004120:0:22729:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941039.004153:0:22729:0:(import.c:65:import_set_state_nolock()) ffff91cf08c3b000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788941039.006495:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941039.006503:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941039.006506:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941039.006509:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941039.006514:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941039.006521:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788941039.006523:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941039.006526:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941039.009412:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3644:x1875839945024000:12345-0@lo:38:llog_process_th.0 Request processed in 5361us (7934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941039.009427:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788941039.009659:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d0065d1180 x1875839945024000/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941049 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941039.009684:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788941039.009694:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:3.0:1788941039.009703:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788941039.009708:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788941039.009711:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf08c3f000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788941039.009717:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3644:1875839945024000:0@lo:38:llog_process_th.0 20000000:01000000:1.0:1788941039.015950:0:22721:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788941039.015979:0:22721:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788941039.016278:0:22743:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788941039.016284:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788941039.016305:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016323:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016331:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 21 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016339:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016376:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 21 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016404:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 21 pid: 22721 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941039.016418:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945024256:0@lo:104: 00000100:00100000:2.0:1788941039.016626:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788941039.016676:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.016684:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941039.016692:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945024384:0@lo:104: 00000100:00100000:2.0:1788941039.016714:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941039.016731:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0051c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788941039.016755:0:22711:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788941039.016769:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024256 00000100:00100000:2.0:1788941039.016776:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024256 00000100:00100000:2.0:1788941039.016813:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024384 00000100:00100000:2.0:1788941039.016816:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024384 00000100:00100000:2.0:1788941039.016829:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941039.016836:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945024256:12345-0@lo:104: 00010000:00010000:2.0:1788941039.016847:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017212:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788941039.017219:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945024256:12345-0@lo:104: Request processed in 382us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941039.017226:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941039.017251:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941039.017284:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035890850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945024384:12345-0@lo:104: 00010000:00010000:2.0:1788941039.017293:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017329:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788941039.017334:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035890850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945024384:12345-0@lo:104: Request processed in 78us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941039.017340:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941039.017397:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945024256:0@lo:104: 00000100:00100000:2.0:1788941039.017406:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945024384:0@lo:104: 00010000:00010000:2.0:1788941039.017421:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017439:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941039.017444:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017450:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584da00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788941039.017454:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017644:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941039.017653:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941039.017659:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788941039.017702:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017710:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941039.017732:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017741:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584da00/0x9c34acc08badecd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecde expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017755:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941039.017759:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017766:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:2.0:1788941039.017769:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017777:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788941039.017784:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941039.017791:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788941039.017803:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017809:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788941039.017825:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017843:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08badecc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecd0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.017855:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941039.017857:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941039.017858:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941039.017865:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941039.017889:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945024512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941039.017921:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941039.017978:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945024640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941039.018004:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941039.018580:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024512 00000100:00100000:0.0:1788941039.018592:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024512 00010000:00010000:0.0:1788941039.018615:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 22 pid: 22721 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941039.018644:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024640 00000100:00100000:0.0:1788941039.018647:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024640 00010000:00010000:0.0:1788941039.018658:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 23 pid: 22722 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941039.018671:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941039.018677:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+23:3648:x1875839945024512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941039.018687:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941039.018692:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 23 pid: 22721 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018703:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 23 pid: 22721 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018718:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035936400/0x9c34acc08badecde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badecd7 expref: 23 pid: 22721 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018730:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941039.018767:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+22:3648:x1875839945024512:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (844us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941039.018775:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788941039.018790:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941039.018796:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+21:3645:x1875839945024640:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941039.018804:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941039.018807:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018827:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018836:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035936200/0x9c34acc08badecd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badecc9 expref: 21 pid: 22722 timeout: 894 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018847:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018855:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788941039.018880:0:22714:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002624911s 00010000:00010000:0.0:1788941039.018885:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018892:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018897:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018902:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018907:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941039.018911:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018918:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018937:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941039.018946:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941039.018985:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065b0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:66773969-0b9c-4025-866a-db20e971736d+20:3645:x1875839945024640:12345-0@lo:103:ldlm_bl.0 Request processed in 188us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941039.018992:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788941039.019364:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945024512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941039.019386:0:22743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.019395:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941039.019402:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08baded86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941039.019428:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945024640:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941039.020708:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+19:24230:x1875839945024128:12345-0@lo:253:mount.lustre.0 Request processed in 18221us (18478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941039.020721:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788941039.020773:0:24230:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:24230:1875839945024128:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788941039.020794:0:24230:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788941039.020797:0:24230:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788941039.020798:0:24230:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788941039.020800:0:24230:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788941039.020801:0:24230:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788941039.020802:0:24230:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788941039.020803:0:24230:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788941039.020804:0:24230:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788941039.020806:0:24230:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788941039.020807:0:24230:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788941039.020818:0:24230:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788941039.026076:0:24230:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788941039.028851:0:24230:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788941039.028862:0:24230:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788941039.028909:0:24230:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788941039.028972:0:24230:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788941039.028993:0:24230:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788941039.029012:0:24230:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788941039.030307:0:24230:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941039.030512:0:24230:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788941039.451626:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788941040.012488:0:24311:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941040.013099:0:24311:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788941040.477031:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788941040.795339:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788941040.795351:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03593f000 from 13 10000000:01000000:1.0:1788941040.795359:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788941040.795427:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941040.795442:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941040.795458:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941040.795497:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945024768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941040.795616:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941040.795806:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941040.795936:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024768 00000100:00100000:2.0:1788941040.795957:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024768 00000100:00100000:2.0:1788941040.796039:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788941040.796052:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+19:22724:x1875839945024768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941040.796070:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941040.796089:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded8d expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.796119:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded8d expref: 20 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.796131:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded8d expref: 20 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.796141:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1c00, rc 0) 00000100:00100000:2.0:1788941040.796193:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+20:22724:x1875839945024768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941040.796211:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788941040.797196:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945024768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941040.797224:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941040.797236:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941040.797338:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945024896:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788941040.797394:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941040.797425:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788941040.800838:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945024896 00000100:00100000:2.0:1788941040.800860:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945024896 00000100:00100000:2.0:1788941040.800977:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788941040.800990:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:22724:x1875839945024896:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941040.801027:0:22721:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941040.801060:0:22721:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941040.801064:0:22721:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788941040.801248:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+20:22724:x1875839945024896:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 260us (3852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941040.801284:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788941040.801363:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945024896:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788941040.801461:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788941040.801473:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.801486:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941040.801513:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788941040.801516:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d0065f9800 from 13 10000000:01000000:2.0:1788941040.801520:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788941040.801562:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.801571:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.801594:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941040.801621:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945025024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941040.801907:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941040.802028:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788941040.802055:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025024 00000100:00100000:2.0:1788941040.802061:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025024 00000100:00100000:2.0:1788941040.802097:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788941040.802105:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:22724:x1875839945025024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941040.802116:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941040.802132:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08baded9b expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.802160:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08baded9b expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.802174:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded9b expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.802183:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1200, rc 0) 00000100:00100000:2.0:1788941040.802218:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945025024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941040.802225:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788941040.802289:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945025024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941040.802303:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.802322:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941040.802377:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945025152:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788941040.802408:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941040.802423:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07f8a300 going to sleep for 11 seconds 00000100:00100000:2.0:1788941040.802437:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025152 00000100:00100000:2.0:1788941040.802441:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025152 00000100:00100000:2.0:1788941040.802465:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788941040.802471:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945025152:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788941040.802484:0:22722:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788941040.803115:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788941040.803123:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:2.0:1788941040.803232:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945025152:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 760us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941040.803242:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788941040.803323:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945025152:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788941040.803385:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788941040.803395:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941040.803406:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941041.314633:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945025280:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941041.314741:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941041.314893:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025280 00000100:00100000:0.0:1788941041.314903:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025280 00000100:00100000:0.0:1788941041.314980:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788941041.314989:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945025280:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788941041.315031:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941041.315075:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945025280:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941041.315081:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788941041.315193:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945025280:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941041.315568:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941041.315577:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945025408:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941041.315615:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941041.315838:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025408 00000100:00100000:1.0:1788941041.315844:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025408 00000100:00100000:1.0:1788941041.315872:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941041.315878:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945025408:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941041.315897:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941041.316130:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945025408:12345-0@lo:41:osp-pre-1-0.0 Request processed in 249us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941041.316138:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788941041.321484:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945025408:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1788941041.509993:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941042.075988:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941042.524364:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941043.547701:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941044.061041:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788941044.380707:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941044.380715:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941044.380718:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941044.380722:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941044.380737:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941044.380746:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788941044.380748:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788941044.380751:0:8:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788941044.380799:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945025920:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.380867:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941044.380931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945025536:0@lo:400:kworker.0 00000100:00100000:0.0:1788941044.380978:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941044.381037:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945026048:0@lo:400:kworker.0 00000100:00100000:0.0:1788941044.381066:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941044.381594:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026048 00000100:00100000:3.0:1788941044.381606:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026048 00000100:00100000:3.0:1788941044.381666:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788941044.381676:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945026048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941044.381743:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945026048:12345-0@lo:400:kworker.0 Request processed in 68us (675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941044.381751:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941044.381776:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945025664:0@lo:400:kworker.0 00010000:00080000:3.0:1788941044.381803:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d1f80 x1875839945026048/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941044.381806:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941044.381819:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945026048:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.381824:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945026176:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.381844:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941044.381861:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788941044.381866:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945025792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.381888:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941044.381903:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945026304:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.381939:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941044.381973:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025920 00000100:00100000:1.0:1788941044.381977:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025920 00000100:00100000:1.0:1788941044.382006:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025664 00000100:00100000:1.0:1788941044.382009:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025664 00000100:00100000:1.0:1788941044.382024:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941044.382031:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945025920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.382069:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945025920:12345-0@lo:400:kworker.0 Request processed in 39us (1202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.382076:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941044.382089:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788941044.382095:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945025664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.382134:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945025664:12345-0@lo:400:kworker.0 Request processed in 39us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.382140:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788941044.382168:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026176 00000100:00100000:2.0:1788941044.382170:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025536 00000100:00100000:1.0:1788941044.382171:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026176 00000100:00100000:2.0:1788941044.382174:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025536 00000100:00100000:1.0:1788941044.382195:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945025792 00000100:00100000:1.0:1788941044.382198:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945025792 00000100:00100000:2.0:1788941044.382200:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788941044.382205:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:3648:x1875839945025536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.382207:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026304 00000100:00100000:1.0:1788941044.382209:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026304 00000100:00100000:1.0:1788941044.382222:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788941044.382226:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945026176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941044.382243:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:3648:x1875839945025536:12345-0@lo:400:kworker.0 Request processed in 37us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941044.382249:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788941044.382251:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945026176:12345-0@lo:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.382278:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788941044.382288:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788941044.382294:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945025792:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788941044.382307:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941044.382311:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941044.382319:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945025792:12345-0@lo:400:kworker.0 Request processed in 26us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.382324:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788941044.382334:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941044.382339:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945026304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.382363:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945026304:12345-0@lo:400:kworker.0 Request processed in 24us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941044.382368:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788941044.382398:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945025920:0@lo:400:kworker.0 00010000:00080000:1.0:1788941044.382417:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d3100 x1875839945025792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941044.382433:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945025792:0@lo:400:kworker.0 00010000:00080000:1.0:1788941044.382443:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d2d80 x1875839945026304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941044.382452:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945026304:0@lo:400:kworker.0 00000100:00100000:1.0:1788941044.382460:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945025664:0@lo:400:kworker.0 00010000:00080000:1.0:1788941044.382468:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d3480 x1875839945026176/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941044.382475:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945026176:0@lo:400:kworker.0 00000100:00100000:3.0:1788941044.382942:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945025536:0@lo:400:kworker.0 00010000:00010000:1.0:1788941044.571877:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941045.149400:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941030/real 1788941030] req@ffff91d03475dc00 x1875839945018240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.149436:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03475dc00 x1875839945018240/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.149447:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941030/real 1788941030] req@ffff91d03475c380 x1875839945018368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941045 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.149458:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d03475c380 x1875839945018368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941045 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788941045.149479:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf079f8800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941045.149504:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941045.149508:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945018240:0@lo:8:kworker.0 00000100:00080000:1.0:1788941045.149515:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941045.149529:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941045.149532:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945018368:0@lo:8:kworker.0 00000100:00080000:3.0:1788941045.149781:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941045.149786:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941045.149788:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941045.149791:0:15176:0:(pinger.c:248:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788941045.149814:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941045.149817:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788941045.149820:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91cf079f8800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941045.149825:0:15176:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 785 00000100:00080000:3.0:1788941045.149831:0:15176:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788941045.149837:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff91cf079f8800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941045.149853:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a51c00 x1875839945026944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941045.149866:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941045.149868:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941045.149869:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941045.149872:0:15176:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 785 00000100:00080000:3.0:1788941045.149874:0:15176:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788941045.149877:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941045.149885:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a50000 x1875839945027072/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941045.149994:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945026560:0@lo:400:kworker.0 00000100:00100000:0.0:1788941045.150059:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941045.150101:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941045.150108:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945026432:0@lo:400:kworker.0 00000100:00100000:0.0:1788941045.150134:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941045.150173:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026560 00000100:00100000:0.0:1788941045.150180:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026560 00000100:00100000:0.0:1788941045.150236:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788941045.150246:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945026560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941045.150724:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026432 00000100:00100000:1.0:1788941045.150729:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026432 00000100:00100000:1.0:1788941045.150756:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788941045.150762:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:3648:x1875839945026432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941045.150801:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:3648:x1875839945026432:12345-0@lo:400:kworker.0 Request processed in 39us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941045.150807:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788941045.150877:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945026560:12345-0@lo:400:kworker.0 Request processed in 633us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941045.150884:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788941045.150999:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945026432:0@lo:400:kworker.0 00000100:00100000:0.0:1788941045.151012:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945026560:0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.151151:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945026688:0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.151189:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941045.151210:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945027456:0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.151228:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941045.151246:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788941045.151251:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945026816:0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.151288:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941045.151440:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945027200:0@lo:400:kworker.0 00000100:00100000:1.0:1788941045.151466:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941045.151488:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941045.151492:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839945027328:0@lo:400:kworker.0 00000100:00100000:1.0:1788941045.151512:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941045.151531:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026688 00000100:00100000:1.0:1788941045.151535:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026688 00000100:00100000:1.0:1788941045.151557:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027456 00000100:00100000:1.0:1788941045.151560:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027456 00000100:00100000:1.0:1788941045.151571:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027200 00000100:00100000:1.0:1788941045.151573:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027200 00000100:00100000:1.0:1788941045.151582:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027328 00000100:00100000:1.0:1788941045.151584:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027328 00000100:00100000:1.0:1788941045.151596:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941045.151602:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945026688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941045.152547:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026816 00000100:00100000:0.0:1788941045.152555:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026816 00000100:00100000:0.0:1788941045.152586:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788941045.152594:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945026816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.154483:0:22729:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788941045.154499:0:22729:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1788941045.154518:0:22728:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788941045.154531:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788941045.154542:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945027456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.154609:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945027456:12345-0@lo:400:kworker.0 Request processed in 71us (3380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941045.154617:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788941045.154656:0:22728:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788941045.154662:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788941045.154669:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945027200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.154707:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945027200:12345-0@lo:400:kworker.0 Request processed in 39us (3240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941045.154712:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788941045.154722:0:22728:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788941045.154728:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788941045.154734:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839945027328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941045.154765:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839945027328:12345-0@lo:400:kworker.0 Request processed in 31us (3252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941045.154770:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788941045.154809:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945026944:0@lo:8:kworker.0 00000100:00100000:3.0:1788941045.154853:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941045.154880:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945027072:0@lo:8:kworker.0 00000100:00100000:3.0:1788941045.154920:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941045.154952:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945026944 00000100:00100000:3.0:1788941045.154958:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945026944 00000100:00100000:3.0:1788941045.154974:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027072 00000100:00100000:3.0:1788941045.154976:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027072 00000100:00100000:3.0:1788941045.154984:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941045.154989:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945026944:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1788941045.155028:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 800 last 0 00000020:00000080:3.0:1788941045.155056:0:24235:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badeda9 00002000:00100000:3.0:1788941045.155069:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff91cf085b7000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1788941045.155074:0:24235:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1788941045.155077:0:24235:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788941045.155494:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1788941045.155518:0:24235:0:(import.c:65:import_set_state_nolock()) ffff91cf085b0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788941045.155560:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839945026944:12345-0@lo:8:kworker.0 Request processed in 569us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941045.155567:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788941045.155582:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788941045.155586:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945027072:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788941045.155598:0:24235:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788941045.156017:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945026816:12345-0@lo:400:kworker.0 Request processed in 3421us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941045.156026:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788941045.160101:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945026816:0@lo:400:kworker.0 00010000:00080000:2.0:1788941045.160140:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a50380 x1875839945027456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941045.160152:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945027456:0@lo:400:kworker.0 00000100:00100000:1.0:1788941045.161796:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945026688:12345-0@lo:400:kworker.0 Request processed in 10184us (10595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941045.161811:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788941045.162786:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a50700 x1875839945026688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.162802:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945026688:0@lo:400:kworker.0 00010000:00080000:1.0:1788941045.162839:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a53100 x1875839945027328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.162848:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839945027328:0@lo:400:kworker.0 00010000:00080000:1.0:1788941045.162859:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a50a80 x1875839945027200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.162867:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945027200:0@lo:400:kworker.0 00010000:00080000:2.0:1788941045.166390:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a51c00 x1875839945026944/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941045.166405:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941045.166415:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788941045.166423:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788941045.166430:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788941045.166433:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf079f8800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788941045.166463:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788941045.166484:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945026944:0@lo:8:kworker.0 00000004:00080000:1.0:1788941045.167819:0:23470:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1788941045.167849:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027712:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1788941045.167946:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941045.167976:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0359e2e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941045.167993:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941045.168003:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945027584:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941045.168028:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941045.168452:0:24236:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788941045.168463:0:24236:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1788941045.168489:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027584 00000100:00100000:2.0:1788941045.168497:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027584 00000100:00100000:2.0:1788941045.175510:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788941045.175536:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839945027584:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941045.175578:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788941045.176613:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3645:x1875839945027584:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1083us (8576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941045.177443:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788941045.177789:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788941045.177857:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d2d80 x1875839945027584/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941045.177883:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945027584:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941045.178433:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027712 00000100:00100000:2.0:1788941045.178441:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027712 00000100:00100000:0.0:1788941045.179606:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788941045.179937:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23470:x1875839945027712:12345-0@lo:7:osp-pre-0-1.0 00002000:00080000:0.0:1788941045.191625:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788941045.191639:0:24595:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788941045.191749:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23470:x1875839945027712:12345-0@lo:7:osp-pre-0-1.0 Request processed in 12128us (23797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941045.191762:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788941045.192191:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d3100 x1875839945027712/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788941061 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941045.192208:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027712:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788941045.192221:0:23470:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788941045.192275:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027840:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788941045.192324:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941045.192348:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788941045.192364:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027840 00000100:00100000:2.0:1788941045.192370:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027840 00000100:00100000:2.0:1788941045.192412:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941045.192430:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23470:x1875839945027840:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:2.0:1788941045.192460:0:24236:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:2.0:1788941045.192523:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23470:x1875839945027840:12345-0@lo:5:osp-pre-0-1.0 Request processed in 95us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941045.192531:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788941045.192558:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06100000 x1875839945027840/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788941061 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941045.192566:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027840:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788941045.192576:0:23470:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788941045.192599:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027968:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788941045.192618:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941045.192645:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788941045.192649:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945027968 00000100:00100000:0.0:1788941045.192652:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945027968 00000100:00100000:0.0:1788941045.192687:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788941045.192693:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23470:x1875839945027968:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788941045.192719:0:24595:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:2.0:1788941045.193739:0:23469:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788941045.193827:0:23469:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 800526569552ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788941045.193834:0:23469:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788941045.203679:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945027072:12345-0@lo:8:kworker.0 Request processed in 48081us (48748us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941045.203695:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788941045.205665:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941045.205677:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941045.205683:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945027072:0@lo:8:kworker.0 00000004:00080000:0.0:1788941045.208661:0:23461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000001:00080000:1.0:1788941045.237094:0:24231:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788941045.237109:0:24231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788941045.237439:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23470:x1875839945027968:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44742us (44815us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788941045.237451:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788941045.237481:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06100000 x1875839945027968/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788941061 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941045.237494:0:23470:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1788941045.237513:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23470:1875839945027968:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1788941045.237531:0:23470:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1788941045.237594:0:23470:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d0065d1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23470:1875839945028096:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788941045.237633:0:23470:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941045.237658:0:23470:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb88540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941045.237689:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028096 00000100:00100000:1.0:1788941045.237696:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028096 00000100:00100000:1.0:1788941045.237741:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941045.237751:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1875839945028096:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1788941045.237804:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23470:x1875839945028096:12345-0@lo:900:osp-pre-0-1.0 Request processed in 55us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941045.237811:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788941045.237821:0:23470:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d0065d1180 x1875839945028096/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941061 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941045.237832:0:23470:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d0065d1180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23470:1875839945028096:0@lo:900:osp-pre-0-1.0 00000001:02000400:0.0:1788941045.289708:0:24604:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788941045.596425:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941046.171398:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941026/real 1788941026] req@ffff91d005045180 x1875839945017088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941046 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.171458:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d005045180 x1875839945017088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941046 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.171474:0:3644:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788941026/real 1788941026] req@ffff91d005046680 x1875839945017216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941046 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.171489:0:3644:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d005046680 x1875839945017216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788941046 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788941046.171514:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941046.171549:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941046.171553:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945017088:0@lo:8:kworker.0 00000100:00080000:1.0:1788941046.171560:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941046.171583:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788941046.171587:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945017216:0@lo:8:kworker.0 00000100:00080000:3.0:1788941046.171754:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941046.171759:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788941046.171762:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941046.171767:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 782 00000100:00080000:3.0:1788941046.171774:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941046.171783:0:8:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d034738000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941046.171805:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a50a80 x1875839945028480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941046.171820:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941046.171823:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941046.171825:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941046.171828:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 782 00000100:00080000:3.0:1788941046.171830:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941046.171833:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941046.171844:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d035a53100 x1875839945028608/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788941046.171887:0:8:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941046.171900:0:8:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941046.171902:0:8:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941046.171906:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 800 00000100:00080000:3.0:1788941046.171909:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1788941046.171913:0:8:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941046.171926:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08d71180 x1875839945029120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941046.171970:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945028224:0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.171989:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945028736:0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.172069:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945028352:0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.173760:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.174605:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.174659:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945029376:0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.174726:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.174742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945028992:0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.174761:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788941046.174769:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945028864:0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.174777:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.174793:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.174817:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945029504:0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.174836:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028224 00000100:00100000:3.0:1788941046.174838:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.174846:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028224 00000100:00100000:3.0:1788941046.174872:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028736 00000100:00100000:3.0:1788941046.174876:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028736 00000100:00100000:3.0:1788941046.174919:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029376 00000100:00100000:3.0:1788941046.174923:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029376 00000100:00100000:1.0:1788941046.174924:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788941046.174934:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:3647:x1875839945028224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.174949:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029504 00000100:00100000:3.0:1788941046.174952:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029504 00000100:00100000:3.0:1788941046.174968:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941046.174973:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945028736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.175033:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945028736:12345-0@lo:400:kworker.0 Request processed in 59us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941046.175042:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788941046.175061:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788941046.175067:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945029376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.175087:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:3647:x1875839945028224:12345-0@lo:400:kworker.0 Request processed in 153us (1335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941046.175090:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945029376:12345-0@lo:400:kworker.0 Request processed in 24us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.175095:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788941046.175096:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788941046.175129:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788941046.175136:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945029504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.175167:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945029504:12345-0@lo:400:kworker.0 Request processed in 32us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.175173:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788941046.175203:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028992 00000100:00100000:1.0:1788941046.175207:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028992 00000100:00100000:1.0:1788941046.175237:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941046.175244:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945028992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.175302:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945028992:12345-0@lo:400:kworker.0 Request processed in 58us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.175308:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788941046.175432:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945028480:0@lo:8:kworker.0 00000100:00100000:1.0:1788941046.175478:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.175499:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945028608:0@lo:8:kworker.0 00000100:00100000:1.0:1788941046.175520:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.175547:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945029120:0@lo:8:kworker.0 00000100:00100000:1.0:1788941046.175569:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.175598:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028480 00000100:00100000:1.0:1788941046.175603:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028480 00000100:00100000:1.0:1788941046.175635:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028608 00000100:00100000:1.0:1788941046.175639:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028608 00000100:00100000:1.0:1788941046.175657:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029120 00000100:00100000:1.0:1788941046.175661:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029120 00000100:00100000:1.0:1788941046.175677:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941046.175682:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839945028480:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788941046.175719:0:24237:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 801 last 0 00000020:00000080:1.0:1788941046.175765:0:24237:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badedb0 00002000:00100000:1.0:1788941046.175788:0:24237:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91cf08c39800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788941046.175793:0:24237:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788941046.175797:0:24237:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788941046.175915:0:24237:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788941046.176748:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788941046.176755:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788941046.176776:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941046.176796:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945028608:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788941046.176817:0:24235:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788941046.176903:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945028608:12345-0@lo:8:kworker.0 Request processed in 95us (1369us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941046.176910:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788941046.176926:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788941046.176930:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945029120:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1788941046.176940:0:24235:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788941046.176966:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3644:x1875839945029120:12345-0@lo:8:kworker.0 Request processed in 34us (1396us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788941046.176973:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788941046.177020:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d71f80 x1875839945029504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941046.177038:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945029504:0@lo:400:kworker.0 00010000:00080000:3.0:1788941046.177054:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a50700 x1875839945028736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941046.177063:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945028736:0@lo:400:kworker.0 00010000:00080000:3.0:1788941046.177076:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d73100 x1875839945029376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941046.177084:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945029376:0@lo:400:kworker.0 00000100:00080000:1.0:1788941046.177284:0:24237:0:(import.c:65:import_set_state_nolock()) ffff91cf08c3c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941046.177352:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839945028480:12345-0@lo:8:kworker.0 Request processed in 1668us (1872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.177360:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788941046.177397:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a50a80 x1875839945028480/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.177406:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788941046.177424:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00100000:0.0:1788941046.177486:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028864 00000100:00100000:0.0:1788941046.177496:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028864 00000100:00100000:0.0:1788941046.177544:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788941046.177552:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945028864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.177598:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945028864:12345-0@lo:400:kworker.0 Request processed in 47us (2803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941046.177604:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788941046.177744:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941046.177776:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945028352 00000100:00100000:0.0:1788941046.177781:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945028352 00000100:00100000:0.0:1788941046.177804:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941046.177810:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945028352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.177853:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945028352:12345-0@lo:400:kworker.0 Request processed in 42us (107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941046.177859:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941046.177902:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945028352:0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.177915:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945029248:0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.177949:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941046.177976:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029248 00000100:00100000:0.0:1788941046.177980:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029248 00000100:00100000:0.0:1788941046.178010:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788941046.178017:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945029248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941046.178050:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945029248:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941046.178056:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1788941046.178084:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d72d80 x1875839945029248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941046.178093:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945029248:0@lo:400:kworker.0 00000100:00100000:3.0:1788941046.178637:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945028864:0@lo:400:kworker.0 00000100:00080000:1.0:1788941046.179139:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788941046.179153:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788941046.179158:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d034738000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788941046.179188:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788941046.179197:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945028480:0@lo:8:kworker.0 00000100:00080000:1.0:1788941046.179221:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941046.179225:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941046.179228:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945028608:0@lo:8:kworker.0 00000100:00080000:1.0:1788941046.179239:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941046.179241:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941046.179244:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945029120:0@lo:8:kworker.0 00000004:00080000:3.0:1788941046.179250:0:22753:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:1.0:1788941046.179290:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945029632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941046.179291:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875839945029760:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788941046.179378:0:22752:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788941046.179505:0:22752:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 801512247758ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788941046.179513:0:22752:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788941046.182204:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.182271:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03598a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788941046.182304:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029760 00000100:00100000:3.0:1788941046.182441:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029760 00000100:00100000:3.0:1788941046.182525:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788941046.182537:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875839945029760:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1788941046.182904:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941046.183157:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.183219:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945028224:0@lo:400:kworker.0 00010000:00080000:1.0:1788941046.183243:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d035a52300 x1875839945028992/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.183269:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945028992:0@lo:400:kworker.0 00000100:00100000:1.0:1788941046.183567:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029632 00000100:00100000:1.0:1788941046.183573:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029632 00000100:00100000:1.0:1788941046.183721:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941046.183732:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839945029632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788941046.183757:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941046.183841:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3647:x1875839945029632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.183858:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788941046.183930:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d73100 x1875839945029632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941046.184027:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945029632:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788941046.185489:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788941046.185651:0:24235:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788941046.185672:0:24235:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788941046.185683:0:24235:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00010000:2.0:1788941046.200026:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.200045:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200065:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.200070:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.200077:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200095:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200113:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200121:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200148:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788941046.200160:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941046.200166:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200175:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941046.200179:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200189:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200207:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200215:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badedb7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.200232:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.200240:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.200241:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.202006:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.202019:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.202033:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.202037:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.202043:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.202056:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.202065:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.202073:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.202096:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.202681:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.202697:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.202710:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.202715:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.202727:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.202758:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.202766:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badedbe lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.202817:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.202819:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.202821:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.203697:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.203709:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.203723:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.203726:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.203730:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.203831:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.203841:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.203849:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.203875:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.203922:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.203933:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.203945:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.203949:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.203959:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.203983:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.203993:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badedc5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204022:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.204024:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.204026:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.204373:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.204382:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204393:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.204396:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.204401:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204410:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204419:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204435:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204460:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.204522:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.204530:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204554:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.204558:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204568:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204586:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204594:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badedcc lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.204630:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.204632:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.204634:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.204932:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.204940:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204949:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.204952:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.204957:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204967:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204975:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.204982:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205001:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.205036:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.205044:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.205053:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.205057:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.205066:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.205089:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.205096:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badedd3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.205128:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.205130:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.205131:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.205866:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.205876:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205904:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.205908:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.205913:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205923:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205932:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205939:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.205959:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.207046:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.207065:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.207079:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.207084:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.207096:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.207127:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.207134:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badedda lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.207169:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.207171:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.207172:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.210786:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.210800:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.210818:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.210823:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.210829:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.210843:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.210968:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.210976:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.211007:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.211611:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.211618:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.211627:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.211632:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.211642:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.211659:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.211667:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badede1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.211688:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.211690:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.211692:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.215233:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.215250:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.215303:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.215308:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.215314:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.215329:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.215339:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.215346:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.215371:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788941046.215506:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941046.215521:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.215536:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941046.215542:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.215555:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.215581:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.215589:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003fc2a010/0x9c34acc08badede8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.215629:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.215641:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.215643:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.216115:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.216124:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216136:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.216140:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.216146:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216159:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216179:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216187:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216208:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.216219:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.216225:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216233:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.216236:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216244:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216255:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216283:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badedef lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216300:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.216310:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.216312:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.216839:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.216846:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216855:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.216858:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.216863:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216872:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216880:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216887:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.216924:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788941046.217444:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.217463:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217474:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.217477:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.217481:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217499:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217507:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217514:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217530:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788941046.217538:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941046.217543:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217551:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.217555:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217564:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217578:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217586:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badedf6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217613:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.217617:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217623:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.217766:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217776:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217787:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217794:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badedfd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.217807:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.217809:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.217811:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941046.218150:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.218950:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.218962:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.218975:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.218984:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.218990:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.219003:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.219012:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.219020:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.219045:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.220034:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.220051:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.220066:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.220071:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.220103:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.220128:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.220135:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adf0f7e/0x9c34acc08badee04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.220170:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.220172:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.220174:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941046.220995:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941046.221008:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.221023:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=801s v=(0 0) 00010000:00010000:0.0:1788941046.221028:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941046.221037:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.221054:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.221064:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.221078:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.221105:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.221139:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.221153:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.221168:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584da00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.221174:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.221187:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.221209:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.221230:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000764efecf/0x9c34acc08badee0b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.221251:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.221253:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.221314:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941046.222355:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941046.222366:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.222378:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=801s v=(0 0) 00010000:00010000:0.0:1788941046.222382:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941046.222388:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.222401:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.222409:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.222416:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.222440:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.222606:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.222617:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.222721:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584dc00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.222727:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.222738:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.222758:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.222767:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2b3a497/0x9c34acc08badee12 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.222800:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.222802:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.222805:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788941046.224122:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941046.224137:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.224156:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=801s v=(0 0) 00010000:00010000:1.0:1788941046.224160:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941046.224167:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.224182:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.224193:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.224201:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.224227:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.224289:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.224306:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.224339:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.224344:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.224356:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.224384:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.224393:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000777eeade/0x9c34acc08badee19 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.224431:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.224434:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.224435:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.232211:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.232232:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.232281:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.232287:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.232296:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.232317:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.232330:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.232339:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.232367:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.232637:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.232647:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.232656:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.232661:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.232672:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.232695:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.232703:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee20 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.232734:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.232736:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.232738:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.233670:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.233680:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.233693:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.233697:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.233703:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.233725:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.233736:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.233745:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.233771:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.234009:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.234016:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.234024:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.234029:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.234048:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.234064:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.234071:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee27 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.234087:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.234090:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.234091:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.234343:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.234350:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.234360:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.234363:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.234368:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.234378:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.234388:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.234407:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.234426:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.234591:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.234598:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.234607:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.234620:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.234629:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.234659:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.234667:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007c0fcb71/0x9c34acc08badee2e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.234682:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.234684:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.234686:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.239965:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.239986:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.240009:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.240014:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.240022:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.240040:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.240051:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.240060:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.240092:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941046.240626:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.240637:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.240648:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.240654:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.240667:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.240691:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.240714:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088a578be/0x9c34acc08badee35 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.240734:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.240736:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.240738:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.240960:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.241371:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.241394:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.241399:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.241405:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.241419:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.241428:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.241436:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.241661:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941046.242251:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.242281:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.242292:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.242297:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.242301:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.242312:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.242333:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.242340:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248145:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941046.248165:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248184:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.248190:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248204:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248233:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248242:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c4875533/0x9c34acc08badee3c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248281:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941046.248286:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248299:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941046.248303:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248312:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248324:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.248332:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.248334:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.248336:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.248931:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788941046.248943:0:24235:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd9cad5/0x9c34acc08badee43 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788941046.249655:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.249665:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.249682:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.249687:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.249695:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.249711:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.249721:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.249740:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.249760:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941046.250057:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.250064:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250072:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.250075:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.250079:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250088:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250095:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250102:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250111:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788941046.250390:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.250395:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250409:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.250412:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.250416:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250426:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250434:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250441:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250457:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941046.250472:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250481:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941046.250486:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250496:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.250509:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941046.250515:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250524:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a86120a/0x9c34acc08badee4a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250543:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941046.250546:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250553:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941046.250557:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250565:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250588:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250596:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095f4001c/0x9c34acc08badee51 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250610:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941046.250613:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250620:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941046.250623:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250631:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250641:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250649:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc359a4d/0x9c34acc08badee58 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.250664:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941046.250665:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941046.250672:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941046.251820:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941046.251831:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.251845:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=801s v=(0 0) 00010000:00010000:2.0:1788941046.251850:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941046.251855:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.251869:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.251901:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.251910:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.251940:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941046.251957:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941046.251963:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.251972:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941046.251975:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.251983:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.251996:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.252003:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000191ca706/0x9c34acc08badee5f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941046.252021:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941046.252022:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941046.252024:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941046.252598:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.253787:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.253800:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.253816:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.253820:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.253825:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.253838:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.253859:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.253868:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.253903:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.253914:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.253922:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.253931:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.253936:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.253944:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.253960:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.253968:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068538022/0x9c34acc08badee66 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.253997:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.253998:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.254000:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.254445:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.254462:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254472:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.254475:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.254479:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254489:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254497:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254504:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254536:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.254695:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.254701:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254710:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.254713:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254722:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254735:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254744:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008dfe903c/0x9c34acc08badee6d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254757:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.254759:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.254761:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.254837:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.254843:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254851:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.254854:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.254858:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254866:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254874:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254880:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.254909:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.254931:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.254936:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254954:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.254957:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254966:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254977:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254984:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fdf7af25/0x9c34acc08badee74 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.254998:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.255000:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.255001:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.255528:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.255536:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.255544:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.255553:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.255558:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.255568:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.255577:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.255584:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.255604:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941046.255693:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941046.255699:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.255708:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941046.255711:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.255720:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.255738:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.255746:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c47496f2/0x9c34acc08badee7b lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941046.255762:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.255764:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.255766:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941046.256112:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.256119:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256128:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.256130:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.256135:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256144:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256154:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256167:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256189:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788941046.256576:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941046.256582:0:24235:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256590:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=801s v=(0 0) 00010000:00010000:3.0:1788941046.256593:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941046.256597:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256606:0:24235:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256614:0:24235:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256622:0:24235:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941046.256774:0:24235:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:3.0:1788941046.256817:0:24235:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:3.0:1788941046.256952:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22753:x1875839945029760:12345-0@lo:5:osp-pre-0-0.0 Request processed in 74413us (74755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941046.256970:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788941046.257044:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875839945029760:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788941046.257063:0:22753:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:3.0:1788941046.257123:0:22753:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875839945029888:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788941046.257164:0:22753:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941046.257193:0:22753:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03598a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788941046.257215:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945029888 00000100:00100000:3.0:1788941046.257223:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945029888 00000100:00100000:3.0:1788941046.257286:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788941046.257297:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22753:x1875839945029888:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788941046.257347:0:24236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00010000:00010000:2.0:1788941046.262073:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788941046.262091:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262108:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941046.262113:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262126:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262155:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262163:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f456f464/0x9c34acc08badee82 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262195:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941046.262212:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262218:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941046.262221:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262229:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262239:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262245:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003295d4df/0x9c34acc08badee89 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941046.262272:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.262274:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941046.262276:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941046.266039:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788941046.276758:0:24231:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788941046.276825:0:24231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788941046.277122:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22753:x1875839945029888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 19819us (19950us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788941046.277136:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788941046.277292:0:22753:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1788941046.277304:0:22753:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22753:1875839945029888:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788941046.277336:0:22753:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000020:00000004:0.0:1788941046.354560:0:24656:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941046.354929:0:24656:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788941046.429913:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945030016:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941046.430012:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941046.430082:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030016 00000100:00100000:1.0:1788941046.430093:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030016 00000100:00100000:1.0:1788941046.430154:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788941046.430176:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945030016:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941046.430223:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941046.430291:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945030016:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941046.430299:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788941046.430827:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945030016:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941046.431059:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788941046.431072:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945030144:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941046.431126:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941046.431163:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030144 00000100:00100000:0.0:1788941046.431169:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030144 00000100:00100000:0.0:1788941046.431201:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941046.431208:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945030144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788941046.431235:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941046.431290:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945030144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941046.431309:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941046.431345:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945030144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788941046.624871:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788941047.375459:0:24706:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788941047.375726:0:24706:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788941047.645118:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941048.667690:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941049.692767:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941050.528304:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941050.528337:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d001378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945030272:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941050.528436:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941050.528538:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030272 00000100:00100000:0.0:1788941050.528548:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030272 00000100:00100000:0.0:1788941050.528631:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788941050.528643:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945030272:12345-0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788941050.528652:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788941050.528680:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941050.528741:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945030272:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941050.528749:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941050.528990:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d001378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945030272:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788941050.716596:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941051.547507:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945030400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941051.547628:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.547748:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030400 00000100:00100000:1.0:1788941051.547759:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030400 00000100:00100000:1.0:1788941051.547818:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941051.547829:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945030400:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941051.547887:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941051.547941:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945030400:12345-0@lo:41:osp-pre-1-0.0 Request processed in 113us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.547948:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941051.548007:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03f8a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945030400:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788941051.549480:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945030528:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941051.549554:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.549625:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030528 00000100:00100000:1.0:1788941051.549635:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030528 00000100:00100000:1.0:1788941051.549718:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941051.549730:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945030528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788941051.549766:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941051.549802:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945030528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.549817:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788941051.549854:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941051.549913:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945030528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941051.550298:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788941051.550314:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945030656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941051.550354:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941051.550395:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030656 00000100:00100000:3.0:1788941051.550399:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030656 00000100:00100000:3.0:1788941051.550428:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788941051.550436:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945030656:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941051.550468:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941051.550503:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945030656:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941051.550508:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788941051.550531:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945030656:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941051.552955:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945030784:0@lo:400:kworker.0 00000100:00100000:3.0:1788941051.553030:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788941051.553092:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941051.553096:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941051.553100:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941051.553104:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 801 00000100:00080000:2.0:1788941051.553108:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788941051.553121:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941051.553147:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf06100e00 x1875839945030912/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788941051.553176:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941051.553178:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941051.553180:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941051.553183:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 801 00000100:00080000:2.0:1788941051.553185:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1788941051.553186:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941051.553193:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf06100380 x1875839945031296/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788941051.553247:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030784 00000100:00100000:1.0:1788941051.553281:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030784 00000100:00100000:1.0:1788941051.553337:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788941051.553345:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:3646:x1875839945030784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.554923:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+21:3646:x1875839945030784:12345-0@lo:400:kworker.0 Request processed in 1571us (1884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.554935:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788941051.554989:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945030912:0@lo:8:kworker.0 00000100:00100000:1.0:1788941051.555042:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.555083:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945031296:0@lo:8:kworker.0 00000100:00100000:1.0:1788941051.555107:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.555158:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945031424:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.555188:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.555213:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941051.555219:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945031552:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.555239:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.555291:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031424 00000100:00100000:1.0:1788941051.555299:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031424 00000100:00100000:1.0:1788941051.555342:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031552 00000100:00100000:1.0:1788941051.555345:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031552 00000100:00100000:0.0:1788941051.555481:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945030912 00000100:00100000:0.0:1788941051.555490:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945030912 00000100:00100000:0.0:1788941051.555516:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031296 00000100:00100000:0.0:1788941051.555518:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031296 00000100:00100000:0.0:1788941051.555535:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788941051.555543:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839945030912:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788941051.555646:0:24237:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788941051.555751:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941051.555758:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875839945031296:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788941051.555769:0:24595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788941051.555815:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788941051.555823:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945031424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941051.555955:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945030784:0@lo:400:kworker.0 00000100:00100000:0.0:1788941051.557244:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839945030912:12345-0@lo:8:kworker.0 Request processed in 1690us (2192us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788941051.557278:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941051.560506:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945031424:12345-0@lo:400:kworker.0 Request processed in 4667us (5299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.560527:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788941051.560812:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788941051.561113:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788941051.561177:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06101500 x1875839945031424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941051.561198:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945031424:0@lo:400:kworker.0 00000100:00100000:0.0:1788941051.561272:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945031552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941051.561500:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3644:x1875839945031296:12345-0@lo:8:kworker.0 Request processed in 5737us (6387us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788941051.561511:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941051.561679:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945031552:12345-0@lo:400:kworker.0 Request processed in 849us (6437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941051.561687:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788941051.561860:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941051.561867:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941051.561871:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945030912:0@lo:8:kworker.0 00000100:00080000:1.0:1788941051.561886:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788941051.561889:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788941051.561893:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945031296:0@lo:8:kworker.0 00000100:00100000:1.0:1788941051.561946:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945031040:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.561994:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.562024:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945031680:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.562048:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.562068:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941051.562075:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945031168:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.562100:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941051.562130:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031040 00000100:00100000:1.0:1788941051.562139:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031040 00000100:00100000:1.0:1788941051.562183:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031680 00000100:00100000:1.0:1788941051.562186:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031680 00000100:00100000:1.0:1788941051.562218:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788941051.562237:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945031040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.562308:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945031040:12345-0@lo:400:kworker.0 Request processed in 72us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.562315:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788941051.562331:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788941051.562337:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945031680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.562362:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945031680:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.562367:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788941051.562736:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06103100 x1875839945031552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941051.562833:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945031552:0@lo:400:kworker.0 00000100:00080000:1.0:1788941051.563119:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788941051.563151:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06102d80 x1875839945031040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941051.563162:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945031040:0@lo:400:kworker.0 00010000:00080000:1.0:1788941051.563173:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf06102680 x1875839945031680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941051.563182:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06102680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945031680:0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.563222:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031168 00000100:00100000:1.0:1788941051.563227:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031168 00000100:00100000:1.0:1788941051.563676:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788941051.563688:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945031168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941051.564143:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945031168:12345-0@lo:400:kworker.0 Request processed in 457us (2040us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941051.564153:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788941051.564820:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945031168:0@lo:400:kworker.0 00010000:00010000:2.0:1788941051.740931:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788941052.315899:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941052.767029:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941053.788753:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941054.300958:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1788941054.605555:0:25051:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788941054.605559:0:25051:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788941054.605560:0:25051:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788941054.605671:0:25051:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff91cf06069800 00000020:01000004:0.0:1788941054.605686:0:25051:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788941054.605700:0:25051:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788941054.605713:0:25051:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91d017e5b3b0) 00000020:00000080:0.0:1788941054.605731:0:25051:0:(obd_config.c:786:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788941054.688043:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788941054.697952:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788941054.698632:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788941054.698925:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788941054.699215:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788941054.699528:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788941054.699919:0:25051:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788941054.703730:0:25051:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788941054.704041:0:25051:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788941054.704060:0:25051:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788941054.704079:0:25051:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08badee97 00000020:01000004:0.0:1788941054.704087:0:25051:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788941054.704115:0:25051:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.125@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788941054.704120:0:25051:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.125@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788941054.704127:0:25051:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788941054.704167:0:25051:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:0.0:1788941054.704172:0:25051:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.125@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788941054.723896:0:25051:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.125@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788941054.723960:0:25051:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.125@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788941054.723965:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788941054.723966:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788941054.723967:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941054.723968:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941054.723969:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941054.723970:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941054.723971:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941054.723973:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941054.723974:0:25051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941054.723979:0:25051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788941054.723982:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788941054.723984:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788941054.723985:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941054.723986:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941054.723987:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941054.723988:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941054.723989:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941054.723990:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941054.723992:0:25051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788941054.724030:0:25051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788941054.724057:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945031808:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788941054.724141:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.724224:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15600 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.724453:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031808 00000100:00100000:1.0:1788941054.724462:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031808 00000100:00100000:1.0:1788941054.724555:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788941054.724567:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:25051:x1875839945031808:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788941054.724609:0:22719:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788941054.724613:0:22719:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788941054.724617:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788941054.724922:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:25051:x1875839945031808:12345-0@lo:253:mount.lustre.0 Request processed in 358us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.724930:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788941054.725025:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945031808:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788941054.725038:0:25051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788941054.725041:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788941054.725042:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788941054.725044:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788941054.725045:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788941054.725046:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788941054.725047:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788941054.725048:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788941054.725050:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788941054.725051:0:25051:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788941054.725076:0:25051:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91cf06069800 from lustre-OST0001 10000000:01000000:3.0:1788941054.725106:0:25051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788941054.725109:0:25051:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788941054.725118:0:25051:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d03ec599d8 local copy 00010000:00010000:3.0:1788941054.725129:0:25051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941054.725209:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945031936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941054.725235:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.725355:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f159c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.725450:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945031936 00000100:00100000:1.0:1788941054.725454:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945031936 00000100:00100000:1.0:1788941054.725483:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788941054.725488:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:25051:x1875839945031936:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941054.725590:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:25051:x1875839945031936:12345-0@lo:501:mount.lustre.0 Request processed in 100us (354us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941054.725598:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788941054.725693:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945031936:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788941054.725707:0:25051:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.125@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788941054.725727:0:25051:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.125@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788941054.725735:0:25051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.725745:0:25051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937200/0x9c34acc08badead1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badead8 expref: -99 pid: 22706 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788941054.725774:0:25051:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91cf06069800 10000000:01000000:0.0:1788941054.725778:0:25051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788941054.725782:0:25051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788941054.725784:0:25051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788941054.725788:0:25051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788941054.725791:0:25051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788941054.725823:0:25051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.725833:0:25051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.725844:0:25051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941054.725859:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032064:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788941054.725888:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941054.725983:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.726018:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032064 00000100:00100000:1.0:1788941054.726023:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032064 00000100:00100000:1.0:1788941054.726080:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788941054.726088:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:25051:x1875839945032064:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788941054.726098:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941054.726112:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001218400/0x9c34acc08badeea5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badee9e expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941054.726137:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001218400/0x9c34acc08badeea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badee9e expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941054.726169:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001218400/0x9c34acc08badeea5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badee9e expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941054.726179:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001218400, rc 0) 00000100:00100000:1.0:1788941054.726214:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032064:12345-0@lo:101:mount.lustre.0 Request processed in 127us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.726221:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788941054.726296:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032064:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941054.726320:0:25051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeea5 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.726331:0:25051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeea5 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788941054.727343:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788941054.727934:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788941054.729773:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1788941054.729848:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1788941054.729875:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1788941054.729888:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1788941054.729898:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1788941054.729910:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1788941054.729923:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1788941054.729936:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1788941054.729950:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:2.0:1788941054.729978:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:2.0:1788941054.729984:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:2.0:1788941054.730133:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941054.730217:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.730850:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00699fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941054.730928:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032192 00000100:00100000:3.0:1788941054.730940:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032192 00000100:00100000:2.0:1788941054.731057:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788941054.731069:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032192:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941054.731340:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032192:12345-0@lo:501:mount.lustre.0 Request processed in 272us (1122us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941054.731350:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788941054.731673:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032192:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941054.731808:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032320:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788941054.731883:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.731948:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d005d6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.731986:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032320 00000100:00100000:0.0:1788941054.731992:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032320 00000100:00100000:0.0:1788941054.732068:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788941054.732078:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032320:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941054.737359:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032320:12345-0@lo:503:mount.lustre.0 Request processed in 5269us (5462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.737398:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788941054.737807:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032320:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941054.738824:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941054.738971:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032448:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941054.739060:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.739168:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.739202:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032448 00000100:00100000:0.0:1788941054.739210:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032448 00000100:00100000:0.0:1788941054.739340:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788941054.739353:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.739866:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032448:12345-0@lo:502:mount.lustre.0 Request processed in 513us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.739896:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.739946:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000040:00080000:2.0:1788941054.740323:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788941054.740358:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788941054.740435:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788941054.740447:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788941054.740455:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788941054.740462:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788941054.740470:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788941054.740478:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788941054.740486:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788941054.740523:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032576:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941054.740562:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.740594:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d005d6f300 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.740599:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032576 00000100:00100000:0.0:1788941054.740605:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032576 00000100:00100000:0.0:1788941054.740646:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788941054.740654:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032576:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.740729:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032576:12345-0@lo:502:mount.lustre.0 Request processed in 75us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.740743:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788941054.740756:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06103100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032576:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788941054.740790:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788941054.740795:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:0.0:1788941054.741807:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788941054.741831:0:25055:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:0.0:1788941054.741841:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788941054.741843:0:25055:0:(obd_config.c:1662:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1788941054.741850:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788941054.741869:0:25055:0:(genops.c:415:class_newdev()) Allocate new device lustre-OST0001 (ffff91d017e5cd88) 00000020:00000080:0.0:1788941054.741902:0:25055:0:(obd_config.c:786:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788941054.741910:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788941054.742003:0:25055:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf06069800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1788941054.742014:0:25055:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788941054.742022:0:25055:0:(genops.c:1393:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x9c34acc08badeeb3 00010000:00010000:2.0:1788941054.746963:0:25055:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788941054.747891:0:25055:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:2.0:1788941054.749735:0:25055:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788941054.752941:0:25055:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788941054.752958:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941054.752966:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941054.752969:0:25055:0:(obd_config.c:1662:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788941054.752972:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941054.752977:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941054.752978:0:25055:0:(obd_config.c:1662:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788941054.752981:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788941054.752983:0:25055:0:(obd_config.c:1636:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788941054.752985:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941054.752987:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941054.752989:0:25055:0:(obd_config.c:1662:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788941054.752991:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788941054.752993:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941054.752995:0:25055:0:(obd_config.c:1662:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788941054.752998:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788941054.753039:0:25055:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788941054.753042:0:25055:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788941054.753044:0:25055:0:(obd_config.c:1662:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788941054.753047:0:25055:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:3.0:1788941054.753377:0:25051:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788941054.753418:0:25051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788941054.753440:0:25051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeea5 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.753455:0:25051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d03584c000/0x9c34acc08badee9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeea5 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941054.753465:0:25051:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf06069800 from 1 10000000:01000000:3.0:1788941054.753468:0:25051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788941054.753521:0:25051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.753530:0:25051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.753542:0:25051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941054.753574:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941054.753667:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.753722:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.753877:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032704 00000100:00100000:0.0:1788941054.753890:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032704 00000100:00100000:0.0:1788941054.753959:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788941054.753972:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+22:25051:x1875839945032704:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788941054.753990:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941054.754006:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeeba expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.754038:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeeba expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.754051:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeeba expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.754063:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584c800, rc 0) 00000100:00100000:0.0:1788941054.754109:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945032704:12345-0@lo:101:mount.lustre.0 Request processed in 140us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.754138:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788941054.754319:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941054.754337:0:25051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.754348:0:25051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941054.755675:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788941054.756057:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941054.756248:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788941054.758726:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788941054.758762:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788941054.758779:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788941054.758792:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788941054.758852:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788941054.758869:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788941054.758884:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788941054.758899:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788941054.758914:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788941054.758929:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788941054.758959:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788941054.758965:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788941054.759133:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941054.759224:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.761640:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15240 going to sleep for 11 seconds 00000100:00100000:2.0:1788941054.761911:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032832 00000100:00100000:2.0:1788941054.761923:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032832 00000100:00100000:2.0:1788941054.762047:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788941054.762058:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945032832:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788941054.762295:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945032832:12345-0@lo:501:mount.lustre.0 Request processed in 238us (3070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941054.762304:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788941054.762452:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941054.762520:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032960:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941054.762575:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.762836:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15240 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.762905:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945032960 00000100:00100000:0.0:1788941054.762911:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945032960 00000100:00100000:0.0:1788941054.762943:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788941054.762952:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945032960:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788941054.763062:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945032960:12345-0@lo:503:mount.lustre.0 Request processed in 111us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.763070:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788941054.763184:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945032960:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941054.763712:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941054.763783:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941054.763840:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.763875:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941054.763974:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033088 00000100:00100000:2.0:1788941054.763980:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033088 00000100:00100000:2.0:1788941054.764025:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788941054.764033:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945033088:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941054.764124:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945033088:12345-0@lo:502:mount.lustre.0 Request processed in 92us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941054.764132:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788941054.764149:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941054.764360:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788941054.764508:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788941054.764526:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788941054.764541:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788941054.764556:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788941054.764568:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788941054.764581:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788941054.764610:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788941054.764625:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788941054.764638:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788941054.764649:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788941054.764675:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033216:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941054.764713:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.764784:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.764832:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033216 00000100:00100000:0.0:1788941054.764839:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033216 00000100:00100000:0.0:1788941054.764913:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788941054.764922:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945033216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.765021:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945033216:12345-0@lo:502:mount.lustre.0 Request processed in 100us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.765029:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788941054.765093:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033216:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788941054.765134:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788941054.765141:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788941054.765730:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941054.765742:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765745:0:25059:0:(obd_config.c:1662:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788941054.765751:0:25059:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf06069800 00000020:00000080:3.0:1788941054.765754:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941054.765764:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941054.765766:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765767:0:25059:0:(obd_config.c:1662:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788941054.765770:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941054.765772:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765774:0:25059:0:(obd_config.c:1662:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788941054.765783:0:25059:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: general-ffff91cf06069800 00000020:00000080:3.0:1788941054.765785:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941054.765867:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941054.765871:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765873:0:25059:0:(obd_config.c:1662:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788941054.765876:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941054.765878:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765880:0:25059:0:(obd_config.c:1662:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788941054.765883:0:25059:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf06069800 00000020:00000080:3.0:1788941054.765885:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941054.765905:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941054.765907:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765909:0:25059:0:(obd_config.c:1662:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788941054.765911:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788941054.765913:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765915:0:25059:0:(obd_config.c:1662:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788941054.765918:0:25059:0:(obd_config.c:2103:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91cf06069800 00000020:00000080:3.0:1788941054.765921:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788941054.765943:0:25059:0:(obd_config.c:1992:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788941054.765946:0:25059:0:(obd_config.c:1571:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788941054.765948:0:25059:0:(obd_config.c:1662:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788941054.765951:0:25059:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788941054.765988:0:25051:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788941054.766014:0:25051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788941054.766037:0:25051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766050:0:25051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941054.766105:0:25051:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788941054.766108:0:25051:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91cf06069800 10000000:01000000:3.0:1788941054.766112:0:25051:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91cf06069800 10000000:01000000:3.0:1788941054.766120:0:25051:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788941054.766126:0:25051:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff91cf06069800 from 1 10000000:01000000:3.0:1788941054.766129:0:25051:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788941054.766165:0:25051:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766174:0:25051:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766183:0:25051:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941054.766205:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033344:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788941054.766283:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.766315:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d004f15240 going to sleep for 11 seconds 00000100:00100000:3.0:1788941054.766335:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033344 00000100:00100000:3.0:1788941054.766341:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033344 00000100:00100000:3.0:1788941054.766379:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788941054.766387:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:25051:x1875839945033344:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941054.766399:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941054.766413:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936000/0x9c34acc08badeecf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badeec8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766439:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936000/0x9c34acc08badeecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badeec8 expref: 24 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766452:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936000/0x9c34acc08badeecf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeec8 expref: 24 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766461:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936000, rc 0) 00000100:00100000:3.0:1788941054.766502:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033344:12345-0@lo:101:mount.lustre.0 Request processed in 115us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.766509:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788941054.766554:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033344:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788941054.766569:0:25051:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeecf expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.766579:0:25051:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badeecf expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941054.777749:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1788941054.778158:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788941054.778488:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1788941054.778515:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1788941054.778547:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1788941054.778560:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1788941054.778571:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1788941054.778582:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1788941054.778593:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1788941054.778604:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1788941054.778615:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1788941054.778628:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1788941054.778641:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1788941054.778652:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1788941054.778664:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1788941054.778676:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1788941054.778690:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1788941054.778702:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1788941054.778716:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1788941054.778728:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1788941054.778755:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1788941054.778779:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1788941054.778793:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1788941054.778805:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1788941054.778833:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1788941054.778847:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1788941054.778861:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1788941054.778876:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1788941054.778890:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1788941054.778901:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1788941054.778914:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1788941054.778926:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1788941054.778939:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1788941054.778952:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1788941054.778963:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1788941054.778974:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1788941054.779002:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1788941054.779016:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1788941054.779029:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1788941054.779042:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1788941054.779055:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1788941054.779067:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1788941054.779080:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1788941054.779091:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1788941054.779104:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1788941054.779118:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1788941054.779130:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1788941054.779140:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1788941054.779152:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1788941054.779165:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1788941054.779321:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1788941054.779353:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1788941054.780801:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1788941054.780831:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1788941054.780988:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941054.781081:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.781143:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.781484:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033472 00000100:00100000:1.0:1788941054.781494:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033472 00000100:00100000:1.0:1788941054.781554:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788941054.781566:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788941054.781727:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033472:12345-0@lo:501:mount.lustre.0 Request processed in 163us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.781735:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788941054.782551:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788941054.782620:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788941054.782685:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.782722:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.782796:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033600 00000100:00100000:1.0:1788941054.782803:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033600 00000100:00100000:1.0:1788941054.782870:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788941054.782880:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788941054.783008:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033600:12345-0@lo:503:mount.lustre.0 Request processed in 129us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.783017:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788941054.783107:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033600:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788941054.785120:0:25051:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788941054.785249:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033728:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788941054.785844:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.785966:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.791513:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033728 00000100:00100000:1.0:1788941054.791534:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033728 00000100:00100000:2.0:1788941054.792580:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788941054.792595:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033728:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941054.792843:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033728:12345-0@lo:502:mount.lustre.0 Request processed in 251us (7000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941054.792851:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788941054.792877:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033728:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941054.793202:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788941054.793244:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788941054.793287:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788941054.793303:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788941054.793318:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788941054.793332:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788941054.793346:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788941054.793359:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788941054.793464:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788941054.793484:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788941054.793518:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788941054.793542:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788941054.793556:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788941054.793568:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788941054.793580:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788941054.793594:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788941054.793607:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788941054.793620:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788941054.793632:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788941054.793645:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788941054.793658:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788941054.793671:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788941054.793684:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788941054.793697:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788941054.793710:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788941054.793724:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788941054.793751:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788941054.793766:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788941054.793778:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788941054.793791:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788941054.793803:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788941054.793830:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788941054.793844:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788941054.793856:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788941054.793869:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788941054.793884:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788941054.793897:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788941054.793910:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788941054.793923:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788941054.793937:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788941054.793950:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788941054.793963:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788941054.793991:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788941054.794007:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788941054.794031:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788941054.794044:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788941054.794057:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788941054.794071:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788941054.794137:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.794225:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941054.794308:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788941054.794489:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033856 00000100:00100000:1.0:1788941054.794500:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033856 00000100:00100000:1.0:1788941054.794558:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788941054.794568:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033856:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788941054.794707:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033856:12345-0@lo:502:mount.lustre.0 Request processed in 140us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.794715:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788941054.795525:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788941054.795765:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788941054.795793:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788941054.795845:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788941054.795913:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941054.795959:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03117b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788941054.795966:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945033984 00000100:00100000:2.0:1788941054.795973:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945033984 00000100:00100000:2.0:1788941054.796021:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788941054.796031:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788941054.796164:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945033984:12345-0@lo:502:mount.lustre.0 Request processed in 134us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941054.796172:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788941054.796309:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945033984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788941054.796359:0:25051:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788941054.796440:0:25051:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788941054.797598:0:25064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788941054.797616:0:25064:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91cf07a04d88) 00000020:00000080:0.0:1788941054.797641:0:25064:0:(obd_config.c:786:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788941054.797729:0:25064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf06069800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788941054.797732:0:25064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf06069800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788941054.797734:0:25064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf06069800 3 00010000:00080000:0.0:1788941054.797764:0:25064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf07be7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00010000:0.0:1788941054.801018:0:25064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788941054.801198:0:25064:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788941054.801248:0:25064:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788941054.801288:0:25064:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x9c34acc08badeedd 00000100:00080000:0.0:1788941054.801304:0:25064:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788941054.801312:0:25064:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91cf07be7000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941054.802030:0:25064:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d00137b100 x1875839945034112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788941054.802083:0:25064:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788941054.803898:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945034112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788941054.804011:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788941054.804171:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941054.804177:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941054.804180:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941054.804186:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 806 00000100:00080000:3.0:1788941054.804191:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788941054.804199:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941054.804221:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08d70e00 x1875839945034496/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941054.804250:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945034368:0@lo:400:kworker.0 00000100:00080000:3.0:1788941054.804292:0:37:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788941054.804296:0:37:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788941054.804302:0:37:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788941054.804306:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 806 00000100:00080000:3.0:1788941054.804309:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:3.0:1788941054.804312:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:3.0:1788941054.804326:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08d71f80 x1875839945035008/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941054.804332:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.804361:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945035136:0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.804367:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945034240:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.804384:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.804396:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.804403:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788941054.804408:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945034624:0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.804413:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945034880:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.804430:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.804432:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.804448:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945035264:0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.804450:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788941054.804454:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945034752:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.804468:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.804473:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.804486:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945035392:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.804501:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034368 00000100:00100000:3.0:1788941054.804507:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941054.804509:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034368 00000100:00100000:3.0:1788941054.804531:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945034496:0@lo:8:kworker.0 00000100:00100000:3.0:1788941054.804557:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941054.804706:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034112 00000100:00100000:1.0:1788941054.804710:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034112 00000100:00100000:1.0:1788941054.804728:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035136 00000100:00100000:1.0:1788941054.804730:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035136 00000020:01000004:0.0:1788941054.804759:0:25064:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000100:00100000:1.0:1788941054.804761:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034624 00000100:00100000:1.0:1788941054.804763:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034624 00000100:00100000:1.0:1788941054.804775:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035264 00000100:00100000:1.0:1788941054.804777:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035264 00000020:00000080:0.0:1788941054.804778:0:25064:0:(genops.c:415:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff91cf07a00000) 00000100:00100000:1.0:1788941054.804789:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035392 00000100:00100000:1.0:1788941054.804791:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035392 00000020:00000080:0.0:1788941054.804808:0:25064:0:(obd_config.c:786:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:1.0:1788941054.804819:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788941054.804829:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945035136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941054.804891:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945035136:12345-0@lo:400:kworker.0 Request processed in 64us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.804900:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788941054.804917:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941054.804922:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945034624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941054.804950:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945034624:12345-0@lo:400:kworker.0 Request processed in 29us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.804956:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788941054.804966:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941054.804978:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945035264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941054.805005:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06102d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945035264:12345-0@lo:400:kworker.0 Request processed in 28us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.805012:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788941054.805024:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788941054.805029:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839945035392:12345-0@lo:400:kworker.0 00000020:01000004:0.0:1788941054.805040:0:25064:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91cf06069800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788941054.805045:0:25064:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91cf06069800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788941054.805048:0:25064:0:(obd_mount.c:710:lustre_put_lsi()) put ffff91cf06069800 3 00000100:00100000:1.0:1788941054.805057:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3648:x1875839945035392:12345-0@lo:400:kworker.0 Request processed in 28us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.805063:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788941054.805075:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941054.805079:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839945034112:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788941054.805097:0:25064:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91cf06deb000@lustre-MDT0001-lwp-OST0001: add connection 192.168.202.125@tcp at head 00010000:00080000:1.0:1788941054.805110:0:22728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 810 last 0 00000020:00000080:1.0:1788941054.805141:0:22728:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x9c34acc08badeeeb 00000004:00100000:1.0:1788941054.805161:0:22728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941054.805195:0:22728:0:(import.c:65:import_set_state_nolock()) ffff91d040a6e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941054.805229:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3644:x1875839945034112:12345-0@lo:38:llog_process_th.0 Request processed in 148us (1218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.805237:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941054.805534:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945035008:0@lo:8:kworker.0 00000100:00100000:3.0:1788941054.805566:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788941054.805896:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d00137b100 x1875839945034112/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941054.805908:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788941054.805917:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:3.0:1788941054.805927:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788941054.805932:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788941054.805943:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf07be7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788941054.805951:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3644:1875839945034112:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788941054.805992:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034240 00000100:00100000:3.0:1788941054.805998:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034240 00000100:00100000:3.0:1788941054.806034:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034752 00000100:00100000:3.0:1788941054.806037:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034752 00000100:00100000:3.0:1788941054.806053:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788941054.806059:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945034240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.806100:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945034240:12345-0@lo:400:kworker.0 Request processed in 40us (1703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.806107:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788941054.806120:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788941054.806126:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945034752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.806152:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945034752:12345-0@lo:400:kworker.0 Request processed in 27us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.806158:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788941054.808641:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034880 00000100:00100000:2.0:1788941054.808661:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034880 00000100:00100000:2.0:1788941054.808738:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945034496 00000100:00100000:2.0:1788941054.808741:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945034496 00000100:00100000:2.0:1788941054.808754:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035008 00000100:00100000:2.0:1788941054.808757:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035008 00000100:00100000:2.0:1788941054.808772:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941054.808783:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945034368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941054.808910:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788941054.808923:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945034880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941054.808983:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945034880:12345-0@lo:400:kworker.0 Request processed in 64us (4550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.808991:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788941054.809011:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945034368:12345-0@lo:400:kworker.0 Request processed in 230us (4678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.809011:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941054.809016:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839945034496:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788941054.809017:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788941054.809028:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941054.809031:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839945035008:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788941054.809110:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839945035008:12345-0@lo:8:kworker.0 Request processed in 77us (3543us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788941054.809117:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788941054.809121:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3644:x1875839945034496:12345-0@lo:8:kworker.0 Request processed in 104us (4564us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788941054.809127:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788941054.809167:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941054.809171:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941054.809185:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941054.809224:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941054.809233:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941054.809238:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788941054.809242:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945034496:0@lo:8:kworker.0 00000100:00100000:2.0:1788941054.809251:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941054.809253:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788941054.809274:0:3644:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788941054.809277:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945035008:0@lo:8:kworker.0 00010000:00080000:2.0:1788941054.809433:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d73b80 x1875839945034624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941054.809447:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945034624:0@lo:400:kworker.0 00010000:00080000:2.0:1788941054.809463:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d71180 x1875839945035264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941054.809473:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945035264:0@lo:400:kworker.0 00010000:00080000:2.0:1788941054.809561:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d73100 x1875839945035136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941054.809572:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945035136:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.809585:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945034368:0@lo:400:kworker.0 00010000:00010000:1.0:1788941054.811156:0:25064:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:1.0:1788941054.811533:0:25064:0:(obd_config.c:900:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:1.0:1788941054.811599:0:25064:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788941054.811617:0:25064:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x9c34acc08badeef2 00000100:00080000:1.0:1788941054.811628:0:25064:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788941054.811637:0:25064:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff91cf06deb000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:1.0:1788941054.811683:0:25064:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08dd3b80 x1875839945035520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788941054.811708:0:25064:0:(pinger.c:374:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00010000:00010000:1.0:1788941054.812460:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941054.812679:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945034752:0@lo:400:kworker.0 00010000:00080000:3.0:1788941054.812700:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91cf08d72d80 x1875839945035392/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941054.812710:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3648:1875839945035392:0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.812723:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945034240:0@lo:400:kworker.0 00000100:00100000:3.0:1788941054.812736:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945034880:0@lo:400:kworker.0 00000100:00100000:2.0:1788941054.812784:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839945035520:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788941054.812905:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941054.813297:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035520 00000100:00100000:1.0:1788941054.813306:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035520 00000100:00100000:1.0:1788941054.813350:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941054.813361:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3644:x1875839945035520:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788941054.813470:0:22728:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 810 last 0 00000020:00000080:1.0:1788941054.813516:0:22728:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x9c34acc08badeef9 00000004:00100000:1.0:1788941054.813535:0:22728:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788941054.813576:0:22728:0:(import.c:65:import_set_state_nolock()) ffff91d040a6f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941054.813642:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3644:x1875839945035520:12345-0@lo:38:llog_process_th.0 Request processed in 281us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.813650:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788941054.814371:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd3b80 x1875839945035520/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788941064 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941054.814396:0:3644:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788941054.814406:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788941054.814416:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788941054.814422:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788941054.814425:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91cf06deb000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788941054.814434:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3644:1875839945035520:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788941054.814968:0:25064:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1788941054.815035:0:25051:0:(obd_config.c:2244:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788941054.815077:0:25051:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788941054.815101:0:25051:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeecf expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941054.815114:0:25051:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035937600/0x9c34acc08badeec8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badeecf expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788941054.815177:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788941054.815180:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788941054.815182:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941054.815183:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941054.815184:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941054.815185:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941054.815187:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788941054.815189:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941054.815191:0:25051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941054.815196:0:25051:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788941054.815199:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788941054.815200:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788941054.815201:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788941054.815203:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788941054.815204:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788941054.815205:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788941054.815206:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788941054.815207:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788941054.815208:0:25051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788941054.815235:0:25051:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788941054.815281:0:25051:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945035648:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788941054.815360:0:25051:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941054.815479:0:25051:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf063749c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941054.815754:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035648 00000100:00100000:0.0:1788941054.815764:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035648 00000100:00100000:0.0:1788941054.815830:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788941054.815841:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945035648:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788941054.815887:0:22719:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788941054.815905:0:22719:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788941054.827967:0:22719:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788941054.828033:0:22719:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788941054.828653:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:25051:x1875839945035648:12345-0@lo:253:mount.lustre.0 Request processed in 12804us (13283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941054.828672:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788941054.829005:0:25051:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:66773969-0b9c-4025-866a-db20e971736d:25051:1875839945035648:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788941054.829026:0:25051:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788941054.829030:0:25051:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788941054.829032:0:25051:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788941054.829034:0:25051:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788941054.829035:0:25051:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788941054.829036:0:25051:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788941054.829037:0:25051:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788941054.829040:0:25051:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788941054.829042:0:25051:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788941054.829044:0:25051:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788941054.829064:0:25051:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:2.0:1788941054.831615:0:25051:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 20000000:01000000:3.0:1788941054.833966:0:22743:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788941054.833982:0:22743:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788941054.834021:0:22743:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834044:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834053:0:22743:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded9b expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834062:0:22743:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834114:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834132:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 23 pid: 22719 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941054.834149:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945035776:0@lo:104: 00000100:00100000:3.0:1788941054.834847:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788941054.834919:0:22743:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.834932:0:22743:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941054.834944:0:22743:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945035904:0@lo:104: 00000100:00100000:3.0:1788941054.834966:0:22743:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941054.834984:0:22743:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d024a26240 going to sleep for 11 seconds 00000100:00100000:3.0:1788941054.835020:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035776 00000100:00100000:3.0:1788941054.835028:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035776 00000100:00100000:3.0:1788941054.835087:0:22710:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945035904 00000100:00100000:3.0:1788941054.835090:0:22710:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945035904 00000100:00100000:3.0:1788941054.835103:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788941054.835112:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945035776:12345-0@lo:104: 00010000:00010000:3.0:1788941054.835127:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.835185:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788941054.835191:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+4:22743:x1875839945035776:12345-0@lo:104: Request processed in 81us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.835198:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788941054.835206:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945035776:0@lo:104: 00000100:00100000:3.0:1788941054.835215:0:22710:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788941054.835222:0:22710:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945035904:12345-0@lo:104: 00010000:00010000:3.0:1788941054.835230:0:22710:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.835846:0:22710:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788941054.835854:0:22710:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:66773969-0b9c-4025-866a-db20e971736d+3:22743:x1875839945035904:12345-0@lo:104: Request processed in 632us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941054.835863:0:22710:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788941054.835885:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941054.835893:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.835902:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0400 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941054.835907:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.835917:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941054.835933:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941054.835940:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788941054.835978:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.835987:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941054.836010:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836019:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02e8e0400/0x9c34acc08baded9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeda2 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836032:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941054.836036:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836042:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941054.836046:0:22715:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836054:0:22715:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941054.836062:0:22715:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941054.836067:0:22715:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788941054.836085:0:22715:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836091:0:22715:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941054.836107:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836114:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08baded8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded94 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941054.836130:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.836132:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.836134:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941054.836140:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941054.836163:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945036032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941054.836197:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:2.0:1788941054.839804:0:25051:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788941054.839827:0:25051:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788941054.839952:0:25051:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788941054.840013:0:25051:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.125@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788941054.840037:0:25051:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:2.0:1788941054.840069:0:25051:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:2.0:1788941054.841238:0:25051:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941054.841697:0:25051:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788941054.842388:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788941054.842421:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945036160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941054.842527:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941054.842631:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036032 00000100:00100000:0.0:1788941054.842643:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036032 00000100:00100000:1.0:1788941054.843401:0:22743:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22743:1875839945035904:0@lo:104: 00010000:00010000:1.0:1788941054.843437:0:22743:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.843805:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 24 pid: 22719 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941054.843869:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036160 00000100:00100000:0.0:1788941054.843875:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036160 00010000:00010000:0.0:1788941054.843896:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 25 pid: 22722 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941054.843913:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941054.843924:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66773969-0b9c-4025-866a-db20e971736d+25:3648:x1875839945036032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941054.843942:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941054.843947:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 25 pid: 22719 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.843959:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 25 pid: 22719 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.843980:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badeda2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08baded9b expref: 25 pid: 22719 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.843996:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941054.844057:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66773969-0b9c-4025-866a-db20e971736d+24:3648:x1875839945036032:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (7859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.844064:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941054.844082:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788941054.844087:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66773969-0b9c-4025-866a-db20e971736d+23:3646:x1875839945036160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941054.844104:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941054.844108:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844118:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844128:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02e8e1c00/0x9c34acc08baded94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08baded8d expref: 23 pid: 22722 timeout: 910 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844139:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844150:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788941054.844166:0:22713:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010185779s 00010000:00010000:0.0:1788941054.844171:0:22713:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844180:0:22713:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844188:0:22713:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844195:0:22713:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844201:0:22713:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941054.844206:0:22713:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844220:0:22713:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844797:0:22713:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844823:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941054.844922:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:66773969-0b9c-4025-866a-db20e971736d+22:3646:x1875839945036160:12345-0@lo:103:ldlm_bl.0 Request processed in 832us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941054.844931:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788941054.844956:0:22743:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844964:0:22743:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941054.844970:0:22743:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035936c00/0x9c34acc08badef00 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22743 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941054.847619:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945036160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788941054.857411:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945036032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941055.655941:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945036288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941055.656047:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941055.658677:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036288 00000100:00100000:1.0:1788941055.659481:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036288 00000100:00100000:1.0:1788941055.659574:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788941055.659587:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945036288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788941055.659636:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941055.660357:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945036288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 769us (4306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941055.660378:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788941055.666630:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945036288:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788941055.835729:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788941055.882916:0:25117:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788941055.883416:0:25117:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:2.0:1788941056.290625:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788941056.290636:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d03593f000 from 14 10000000:01000000:2.0:1788941056.290644:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788941056.290711:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941056.290726:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941056.290741:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941056.290779:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941056.290908:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941056.290966:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03ed2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788941056.291069:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036416 00000100:00100000:3.0:1788941056.291081:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036416 00000100:00100000:3.0:1788941056.291156:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788941056.291169:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945036416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941056.291188:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941056.291206:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035936400/0x9c34acc08badef0e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badef07 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291237:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035936400/0x9c34acc08badef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badef07 expref: 23 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291280:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035936400/0x9c34acc08badef0e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badef07 expref: 23 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291292:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035936400, rc 0) 00000100:00100000:3.0:1788941056.291346:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945036416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 179us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941056.291368:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788941056.291429:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941056.291448:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef0e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291459:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badef0e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941056.291518:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036544:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788941056.291553:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941056.291569:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bc87300 going to sleep for 11 seconds 00000100:00100000:3.0:1788941056.291584:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036544 00000100:00100000:3.0:1788941056.291588:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036544 00000100:00100000:3.0:1788941056.291612:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788941056.291618:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945036544:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941056.291636:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941056.291657:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941056.291661:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788941056.291744:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945036544:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941056.291759:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788941056.291790:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036544:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788941056.291870:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788941056.291878:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef0e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291888:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602e00/0x9c34acc08badef07 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef0e expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941056.291899:0:22724:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788941056.291902:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff91d0065f9800 from 14 10000000:01000000:3.0:1788941056.291905:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788941056.291922:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291930:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.291939:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941056.291952:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788941056.291992:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941056.292007:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bc87300 going to sleep for 11 seconds 00000100:00100000:3.0:1788941056.292018:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036672 00000100:00100000:3.0:1788941056.292022:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036672 00000100:00100000:3.0:1788941056.292045:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788941056.292051:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945036672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941056.292066:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941056.292075:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035937400/0x9c34acc08badef1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badef15 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.292090:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035937400/0x9c34acc08badef1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badef15 expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.292100:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035937400/0x9c34acc08badef1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badef15 expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.292108:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937400, rc 0) 00000100:00100000:3.0:1788941056.292136:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945036672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941056.292143:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788941056.292171:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941056.292182:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef1c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.292190:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badef1c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941056.292226:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036800:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788941056.292280:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941056.292293:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00bc87300 going to sleep for 11 seconds 00000100:00100000:3.0:1788941056.292305:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036800 00000100:00100000:3.0:1788941056.292308:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036800 00000100:00100000:3.0:1788941056.292328:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788941056.292334:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945036800:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788941056.292351:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788941056.292362:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788941056.292365:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:3.0:1788941056.292423:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945036800:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 88us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941056.292430:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788941056.292459:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945036800:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788941056.292499:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788941056.292504:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef1c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941056.292511:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d035936200/0x9c34acc08badef15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badef1c expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941056.667828:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945036928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941056.667932:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941056.668525:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945036928 00000100:00100000:3.0:1788941056.668540:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945036928 00000100:00100000:3.0:1788941056.668612:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788941056.668627:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945036928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788941056.668660:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941056.668706:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788941056.668717:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945037056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941056.668762:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941056.668808:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037056 00000100:00100000:1.0:1788941056.668813:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037056 00000100:00100000:1.0:1788941056.668848:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788941056.668855:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945037056:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941056.668890:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941056.668898:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945036928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 277us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941056.668906:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788941056.668920:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945037056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941056.668926:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788941056.668977:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945037056:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941056.669020:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945036928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788941056.669361:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941056.669483:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945037184:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941056.669535:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941056.669596:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037184 00000100:00100000:2.0:1788941056.669602:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037184 00000100:00100000:2.0:1788941056.669643:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941056.669652:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945037184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788941056.669681:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788941056.669737:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945037184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941056.669744:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788941056.669852:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945037184:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788941056.868498:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941057.884178:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941058.910435:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941059.937148:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788941060.251507:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941060.251517:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941060.251522:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941060.251540:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d03fae8000 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:0.0:1788941060.251553:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941060.251570:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf06101c00 x1875839945037696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788941060.251596:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945037312:0@lo:400:kworker.0 00000100:00080000:2.0:1788941060.251618:0:15176:0:(pinger.c:230:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788941060.251622:0:15176:0:(pinger.c:238:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788941060.251624:0:15176:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788941060.251630:0:15176:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff91d00d252800 using connection 192.168.202.125@tcp/0@lo 00000100:00100000:2.0:1788941060.251645:0:15176:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91cf08d70700 x1875839945038208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788941060.251711:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945037440:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.251767:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941060.251788:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945037952:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260044:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260116:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945038080:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260154:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260177:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945038720:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260207:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260237:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788941060.260246:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945037568:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260292:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260315:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945038336:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260351:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260368:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945038848:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260388:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260425:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945037696:0@lo:8:kworker.0 00000100:00100000:2.0:1788941060.260450:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260471:0:3644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945038208:0@lo:8:kworker.0 00000100:00100000:2.0:1788941060.260491:0:3644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.260552:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037440 00000100:00100000:2.0:1788941060.260561:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037440 00000100:00100000:2.0:1788941060.260612:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941060.260622:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945037440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260683:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945037440:12345-0@lo:400:kworker.0 Request processed in 63us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.260690:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788941060.260716:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038080 00000100:00100000:2.0:1788941060.260721:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038080 00000100:00100000:2.0:1788941060.260781:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037568 00000100:00100000:2.0:1788941060.260784:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037568 00000100:00100000:2.0:1788941060.260798:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037696 00000100:00100000:2.0:1788941060.260801:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037696 00000100:00100000:2.0:1788941060.260809:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038208 00000100:00100000:2.0:1788941060.260811:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038208 00000100:00100000:2.0:1788941060.260820:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788941060.260825:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945038080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260855:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945038080:12345-0@lo:400:kworker.0 Request processed in 30us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.260860:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788941060.260871:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941060.260877:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945037568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.260902:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945037568:12345-0@lo:400:kworker.0 Request processed in 26us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.260908:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788941060.260919:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788941060.260922:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839945037696:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788941060.260948:0:24236:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 815 last 0 00000020:00000080:2.0:1788941060.260978:0:24236:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x9c34acc08badef23 00002000:00100000:2.0:1788941060.260992:0:24236:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91cf08dfb800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788941060.260996:0:24236:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788941060.260999:0:24236:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788941060.261212:0:24236:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788941060.261241:0:24236:0:(import.c:65:import_set_state_nolock()) ffff91cf08dfc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941060.261308:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3644:x1875839945037696:12345-0@lo:8:kworker.0 Request processed in 384us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.261325:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788941060.261340:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941060.261344:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3644:x1875839945038208:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788941060.261358:0:24236:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 815 last 0 00000020:00000080:2.0:1788941060.261376:0:24236:0:(genops.c:1393:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x9c34acc08badef2a 00002000:00100000:2.0:1788941060.261390:0:24236:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff91cf08dff800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788941060.261393:0:24236:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788941060.261396:0:24236:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788941060.261419:0:24236:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788941060.261430:0:24236:0:(import.c:65:import_set_state_nolock()) ffff91cf08df9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941060.261457:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3644:x1875839945038208:12345-0@lo:8:kworker.0 Request processed in 111us (965us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.261463:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788941060.261488:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038720 00000100:00100000:2.0:1788941060.261493:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038720 00000100:00100000:2.0:1788941060.261526:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038336 00000100:00100000:2.0:1788941060.261529:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038336 00000100:00100000:2.0:1788941060.261539:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038848 00000100:00100000:2.0:1788941060.261541:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038848 00000100:00100000:2.0:1788941060.261555:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788941060.261562:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945038720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.261595:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945038720:12345-0@lo:400:kworker.0 Request processed in 34us (1388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.261602:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788941060.261613:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788941060.261618:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945038336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.261655:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945038336:12345-0@lo:400:kworker.0 Request processed in 36us (1304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.261660:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788941060.261671:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788941060.261676:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945038848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.261701:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945038848:12345-0@lo:400:kworker.0 Request processed in 25us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.261706:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1788941060.261743:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941060.261747:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941060.261749:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788941060.261806:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06101c00 x1875839945037696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941060.261820:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788941060.261828:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788941060.261834:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788941060.261836:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d03fae8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788941060.261860:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788941060.261867:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3644:1875839945037696:0@lo:8:kworker.0 00010000:00080000:2.0:1788941060.261879:0:3644:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d70700 x1875839945038208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788941085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788941060.261888:0:3644:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788941060.261892:0:3644:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788941060.261895:0:3644:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788941060.261897:0:3644:0:(import.c:65:import_set_state_nolock()) ffff91d00d252800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788941060.261909:0:3644:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788941060.261918:0:3644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3644:1875839945038208:0@lo:8:kworker.0 00000004:00080000:2.0:1788941060.261971:0:23472:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788941060.261990:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945039104:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788941060.262021:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.262039:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c180 going to sleep for 11 seconds 00000004:00080000:2.0:1788941060.262055:0:23471:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788941060.262124:0:23471:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 815594866544ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788941060.262131:0:23471:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788941060.262178:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945037568:0@lo:400:kworker.0 00010000:00080000:2.0:1788941060.262191:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d72d80 x1875839945038336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941060.262200:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945038336:0@lo:400:kworker.0 00010000:00080000:2.0:1788941060.262209:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d71180 x1875839945038848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941060.262216:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945038848:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.262226:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945037440:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.262236:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945038080:0@lo:400:kworker.0 00010000:00080000:2.0:1788941060.262245:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d73100 x1875839945038720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941060.262252:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945038720:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.262299:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039104 00000100:00100000:2.0:1788941060.262303:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039104 00000100:00100000:2.0:1788941060.262331:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941060.262337:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23472:x1875839945039104:12345-0@lo:7:osp-pre-1-1.0 00000100:00080000:2.0:1788941060.262576:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1788941060.263037:0:22755:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788941060.263055:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875839945039360:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788941060.263096:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941060.263119:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf08c30e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788941060.263133:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039360 00000100:00100000:1.0:1788941060.263139:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039360 00000100:00100000:1.0:1788941060.263176:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788941060.263183:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22755:x1875839945039360:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:1.0:1788941060.263226:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788941060.264449:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037312 00000100:00100000:0.0:1788941060.264466:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037312 00000100:00100000:0.0:1788941060.264534:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788941060.264545:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:3645:x1875839945037312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.265909:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08632850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:3645:x1875839945037312:12345-0@lo:400:kworker.0 Request processed in 1357us (14145us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.265942:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788941060.267978:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:66773969-0b9c-4025-866a-db20e971736d:3645:1875839945037312:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268031:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945037824:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268222:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941060.268359:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037824 00000100:00100000:0.0:1788941060.268370:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037824 00000100:00100000:0.0:1788941060.268441:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788941060.268453:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945037824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268571:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945037824:12345-0@lo:400:kworker.0 Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.268580:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788941060.268623:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06101500 x1875839945037824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941060.268638:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06101500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945037824:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268647:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945038464:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268673:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941060.268698:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038464 00000100:00100000:0.0:1788941060.268702:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038464 00000100:00100000:0.0:1788941060.268786:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788941060.268793:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945038464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.268836:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945038464:12345-0@lo:400:kworker.0 Request processed in 44us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.268843:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788941060.268870:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:0.0:1788941060.268959:0:23461:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00010000:00080000:0.0:1788941060.269013:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d71500 x1875839945038464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941060.269023:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945038464:0@lo:400:kworker.0 00000100:00100000:0.0:1788941060.269033:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945038976:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941060.269079:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941060.269111:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038976 00000100:00100000:0.0:1788941060.269115:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038976 00000004:00080000:3.0:1788941060.269212:0:22754:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1788941060.269501:0:22754:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 815602242627ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788941060.269514:0:22754:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788941060.269643:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941060.269700:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839945038592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941060.269736:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941060.269785:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945039232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941060.269812:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941060.270006:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039232 00000100:00100000:0.0:1788941060.270015:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039232 00000100:00100000:0.0:1788941060.270051:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788941060.270061:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875839945038976:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941060.270098:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941060.270170:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3645:x1875839945038976:12345-0@lo:13:osp-pre-1-1.0 Request processed in 108us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.270178:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00002000:00080000:2.0:1788941060.270483:0:24236:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:2.0:1788941060.270492:0:24236:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788941060.270560:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+7:23472:x1875839945039104:12345-0@lo:7:osp-pre-1-1.0 Request processed in 8221us (8536us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.270571:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788941060.270632:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005045500 x1875839945039104/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788941076 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941060.270646:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005045500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945039104:0@lo:7:osp-pre-1-1.0 00000004:00080000:2.0:1788941060.270660:0:23472:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:2.0:1788941060.270695:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945039488:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788941060.270717:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941060.270733:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788941060.270747:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039488 00000100:00100000:2.0:1788941060.270752:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039488 00000100:00100000:0.0:1788941060.271331:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941060.271344:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839945039232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788941060.271364:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941060.271414:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3646:x1875839945039232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (1601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.271419:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788941060.271479:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945038592 00000100:00100000:0.0:1788941060.271486:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945038592 00000100:00100000:2.0:1788941060.271498:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788941060.271511:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23472:x1875839945039488:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788941060.271544:0:24235:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788941060.271545:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788941060.271563:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839945038592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.271604:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23472:x1875839945039488:12345-0@lo:5:osp-pre-1-1.0 Request processed in 93us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.271613:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788941060.271644:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839945038592:12345-0@lo:400:kworker.0 Request processed in 84us (1904us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941060.271652:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788941060.271667:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d73100 x1875839945039488/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788941076 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941060.271679:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945039488:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788941060.271690:0:23472:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00010000:00080000:3.0:1788941060.272228:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd1500 x1875839945039232/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941060.272247:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945039232:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788941060.272290:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08d71c00 x1875839945038592/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941060.272299:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839945038592:0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.272487:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945037952 00000100:00100000:2.0:1788941060.272494:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945037952 00000100:00100000:2.0:1788941060.272535:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788941060.272542:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945037952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941060.272596:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945037952:12345-0@lo:400:kworker.0 Request processed in 55us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.272603:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:2.0:1788941060.275295:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:1.0:1788941060.275476:0:24595:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788941060.275486:0:24595:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788941060.275494:0:24595:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00000100:00100000:2.0:1788941060.275883:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945037952:0@lo:400:kworker.0 00000100:00080000:0.0:1788941060.275950:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:0.0:1788941060.276058:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005046a00 x1875839945038976/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788941076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941060.276096:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005046a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945038976:0@lo:13:osp-pre-1-1.0 00002000:00010000:1.0:1788941060.294141:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941060.294159:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.294182:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=815s v=(0 0) 00010000:00010000:1.0:1788941060.294187:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941060.294195:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.294216:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.294240:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.294248:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.294295:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788941060.295284:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788941060.295292:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.295303:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=815s v=(0 0) 00010000:00010000:1.0:1788941060.295307:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788941060.295312:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.295462:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.295471:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.295479:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.295543:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788941060.300624:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941060.300642:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.300659:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001218e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.300664:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.300675:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.300713:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.300721:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000269f3c10/0x9c34acc08badef31 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300896:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.300904:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300912:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.300915:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300924:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300938:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300947:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a1db07b/0x9c34acc08badef38 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.300964:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.300966:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.300967:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788941060.301104:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788941060.301112:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.301124:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=815s v=(0 0) 00010000:00010000:3.0:1788941060.301129:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941060.301135:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.301147:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.301156:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.301164:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.301186:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788941060.301444:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788941060.301449:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.301457:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941060.301460:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.301468:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.301483:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.301490:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdf7af25/0x9c34acc08badef3f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.301518:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941060.301519:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941060.301521:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.301576:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.304635:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.304651:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.304669:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.304674:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.304680:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.304696:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.304706:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.304713:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.304742:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.305153:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.305160:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.305181:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.305184:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.305189:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.305199:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.305209:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.305217:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.305236:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788941060.306311:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.306416:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.306428:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.306431:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.306436:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.306447:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.306468:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.306476:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.306488:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788941060.306771:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788941060.306780:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306789:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.306793:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306804:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306823:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306830:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191ca706/0x9c34acc08badef46 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306852:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941060.306856:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306862:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.306864:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306872:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306894:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306901:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e085d3aa/0x9c34acc08badef4d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306915:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.306918:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306924:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.306926:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306933:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306941:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306947:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000168bfa8b/0x9c34acc08badef54 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.306957:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.306959:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.306966:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.307525:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.307534:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.307545:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.307549:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.307555:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.307567:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.307575:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.307582:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.307612:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.308818:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.308828:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.308841:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.308844:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.308850:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.308860:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.308867:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.308875:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.308885:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941060.309508:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941060.309517:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309538:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.309542:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309552:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309569:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309577:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000723bce7a/0x9c34acc08badef5b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309592:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.309596:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309602:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.309605:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309613:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309621:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309632:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017bebf08/0x9c34acc08badef62 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.309645:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.309647:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.309648:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.309655:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.309754:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.309770:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.309779:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.309788:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.309793:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.309803:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.309810:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.309817:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.309837:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.313272:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.313288:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.313305:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.313309:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.313600:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.313617:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.313629:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.313654:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.313854:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941060.314313:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941060.314331:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314341:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.314346:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314357:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314374:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314382:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b447bd1b/0x9c34acc08badef69 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314404:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.314408:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314421:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.314425:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314433:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314444:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314451:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fe99040/0x9c34acc08badef70 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.314465:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.314467:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.314469:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.314477:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788941060.317978:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788941060.317998:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318016:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=815s v=(0 0) 00010000:00010000:0.0:1788941060.318021:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941060.318028:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318045:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318056:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318066:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318105:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941060.318128:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941060.318134:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318143:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584ce00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.318147:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318157:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318174:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318182:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b894caf8/0x9c34acc08badef77 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.318199:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.318201:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.318203:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.320887:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.320902:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.320917:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.320921:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.320926:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.320939:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.320949:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.320957:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.320979:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941060.321602:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.321609:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.321619:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.321623:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.321633:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.321650:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.321658:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7465f99/0x9c34acc08badef7e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.321679:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.321681:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.321682:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.321884:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.321890:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.321909:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.321912:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.321917:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.321933:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.321942:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.321950:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.321973:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.322573:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.322580:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.322588:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.322591:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.322596:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.322605:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.322623:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.322630:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.322650:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788941060.322928:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941060.322934:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.322943:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602c00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.322947:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.322966:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.322978:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.322985:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cfa9ccfa/0x9c34acc08badef85 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323002:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.323005:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323010:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.323013:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323019:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323028:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323034:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081dcf376/0x9c34acc08badef8c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323057:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.323058:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.323060:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.323114:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.323194:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.323199:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323207:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.323209:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.323213:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323221:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323228:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323235:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323285:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941060.323645:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.323650:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323657:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.323661:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323668:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323679:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323686:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0a91b69/0x9c34acc08badef93 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.323702:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.323704:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.323706:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.323913:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.323919:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323927:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.323930:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.323934:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323944:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323952:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323960:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.323979:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941060.324244:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941060.324251:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.324309:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.324312:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.324332:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.324345:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.324351:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008a8bb502/0x9c34acc08badef9a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.324368:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.324370:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.324372:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.324600:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.324606:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.324613:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.324622:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.324626:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.324636:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.324644:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.324651:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.324671:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941060.324915:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.324922:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.324941:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.324945:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.324953:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.324964:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.324970:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080764a9f/0x9c34acc08badefa1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.324985:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.324986:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.324988:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.325059:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.325065:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.325073:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.325076:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.325080:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.325089:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.325098:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.325112:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.325189:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941060.325640:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941060.325646:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.325654:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.325658:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.325665:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.325687:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.325694:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e87ddc7/0x9c34acc08badefa8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.325715:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.325717:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.325719:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.329660:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.329678:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.329697:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.329701:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.329708:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.329724:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.329733:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.329741:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.329801:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941060.330287:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.330296:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.330306:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.330310:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.330330:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.330360:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.330369:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002099389a/0x9c34acc08badefaf lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.330391:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.330393:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.330395:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.334775:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.334790:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.334819:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.334824:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.334832:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.334848:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.334860:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.334868:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.334895:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788941060.335470:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.335479:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.335488:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.335493:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.335516:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.335535:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.335543:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000173348c3/0x9c34acc08badefb6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.335562:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.335564:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.335565:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.336455:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.336463:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.336474:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.336478:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.336484:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.336494:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.336513:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.336520:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.336537:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788941060.336969:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.336977:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.336985:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6800 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.336989:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.336998:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.337013:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.337021:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000064f8e8ad/0x9c34acc08badefbd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.337051:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.337053:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.337054:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.337685:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.337693:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.337702:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.337706:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.337711:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.337721:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.337730:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.337737:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.337780:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.338138:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.338144:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338153:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.338156:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.338160:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338169:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338177:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338185:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338203:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788941060.338521:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941060.338528:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338536:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7e00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.338540:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338548:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338561:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338568:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd7b3878/0x9c34acc08badefc4 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338586:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941060.338589:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338595:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.338605:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338613:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338623:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338629:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e8b36b/0x9c34acc08badefcb lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.338639:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.338641:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941060.338642:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.338707:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.338712:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338720:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.338728:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.338734:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338744:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338751:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338771:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.338825:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.340313:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.340338:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.340353:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.340358:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.340364:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.340375:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.340385:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.340403:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.348652:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941060.348670:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.348685:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:3.0:1788941060.348689:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.348701:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.348726:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941060.348745:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a0c5de69/0x9c34acc08badefd2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.349783:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.349793:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.349804:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.349808:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.349817:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.349833:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.349856:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.349857:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.349860:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.349887:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.349890:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.349891:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941060.349995:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788941060.350005:0:24595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594c2e96/0x9c34acc08badefd9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788941060.350799:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.350808:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.350822:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.350826:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.350834:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.350849:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.350858:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.350866:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.350906:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941060.351229:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941060.351237:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.351246:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6000 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.351250:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.351273:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.351286:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.351294:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000024df3b2/0x9c34acc08badefe0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.351333:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.351335:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.351336:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.351504:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.351510:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351519:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.351522:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.351526:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351535:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351542:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351549:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351570:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.351823:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.351829:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351837:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.351846:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.351850:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351859:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351867:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351873:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.351881:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788941060.352141:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788941060.352149:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352157:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7400 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.352161:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352169:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352181:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352188:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d281b4a/0x9c34acc08badefe7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352206:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.352209:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352228:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.352232:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352240:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352251:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352281:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6d46e38/0x9c34acc08badefee lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.352294:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.352295:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.352297:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.352576:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.352582:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.352590:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.352593:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.352598:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.352606:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.352613:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.352627:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.352649:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.355530:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.355548:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.355566:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.355569:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.355575:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.355590:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.355598:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.355606:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.355619:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788941060.356054:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941060.356062:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356071:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.356076:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356087:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356103:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356111:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013dbbeea/0x9c34acc08badeff5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356146:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941060.356150:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356157:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fa200 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.356167:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356175:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356186:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356193:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000920edc3e/0x9c34acc08badeffc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.356207:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.356209:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941060.356210:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.356337:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788941060.356526:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.356534:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.356548:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.356552:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.356556:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.356567:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.356575:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.356582:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.356638:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788941060.358096:0:24595:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788941060.358107:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.358135:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=815s v=(0 0) 00010000:00010000:2.0:1788941060.358139:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941060.358145:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.358156:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.358180:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.358187:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.363721:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788941060.363742:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.363775:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fbe00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941060.363781:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.363798:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.363836:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941060.363859:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c1e22dc/0x9c34acc08badf003 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941060.364868:0:24595:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788941060.365278:0:24595:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00010000:00010000:1.0:1788941060.365508:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788941060.365517:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.365529:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fa600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941060.365534:0:22716:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.365555:0:22716:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.365573:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.365581:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60f0f6c/0x9c34acc08badf00a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941060.365605:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.365607:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788941060.365609:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941060.365710:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22755:x1875839945039360:12345-0@lo:5:osp-pre-1-0.0 Request processed in 102523us (102609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941060.365722:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1788941060.365767:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941060.365770:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788941060.365772:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941060.365841:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875839945039360:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788941060.365860:0:22755:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1788941060.365917:0:22755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875839945039616:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788941060.365956:0:22755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941060.365987:0:22755:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06374cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941060.366037:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039616 00000100:00100000:2.0:1788941060.366046:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039616 00000100:00100000:2.0:1788941060.366096:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788941060.366106:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22755:x1875839945039616:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788941060.366245:0:24236:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00000001:00080000:2.0:1788941060.378581:0:25052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1788941060.378632:0:25052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788941060.378638:0:25052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788941060.378796:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22755:x1875839945039616:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12688us (12835us total) trans 12884901889 rc 0/0 00000100:00100000:2.0:1788941060.378809:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788941060.378881:0:22755:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788941060.378889:0:22755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22755:1875839945039616:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788941060.378907:0:22755:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000100:00100000:1.0:1788941060.770909:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788941060.770931:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945039744:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788941060.770997:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941060.771044:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039744 00000100:00100000:1.0:1788941060.771051:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039744 00000100:00100000:1.0:1788941060.771098:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941060.771107:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945039744:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788941060.771145:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941060.771192:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945039744:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941060.771199:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788941060.771249:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945039744:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788941060.964097:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941061.788396:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941061.788416:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945039872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941061.788483:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941061.788533:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945039872 00000100:00100000:3.0:1788941061.788542:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945039872 00000100:00100000:3.0:1788941061.788588:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788941061.788596:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945039872:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941061.788629:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941061.788673:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945039872:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941061.788680:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788941061.789828:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945039872:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941061.796421:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788941061.796447:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941061.796521:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941061.796641:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040000 00000100:00100000:1.0:1788941061.796651:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040000 00000100:00100000:1.0:1788941061.796719:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941061.796728:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945040000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788941061.796762:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941061.796811:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945040000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941061.796817:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941061.796864:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945040000:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941061.810817:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788941061.810844:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945040128:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788941061.810921:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941061.810972:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040128 00000100:00100000:1.0:1788941061.810980:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040128 00000100:00100000:1.0:1788941061.811024:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941061.811032:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945040128:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941061.811209:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941061.811284:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945040128:12345-0@lo:41:osp-pre-0-1.0 Request processed in 226us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941061.811291:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788941061.811404:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945040128:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788941061.982880:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788941062.575128:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941063.006386:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788941063.168904:0:25407:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg225-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788941064.036196:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788941064.291864:0:25459:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788941064.292148:0:25459:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788941064.539984:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941065.052364:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941065.372186:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945040384:0@lo:5:osp-pre-1-1.0 00000100:00100000:2.0:1788941065.373616:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.373698:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788941065.373748:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945040256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941065.374442:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.374537:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040384 00000100:00100000:2.0:1788941065.374549:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040384 00000100:00100000:2.0:1788941065.374619:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788941065.374631:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:23472:x1875839945040384:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:2.0:1788941065.374689:0:24237:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:3.0:1788941065.375505:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040256 00000100:00100000:3.0:1788941065.375515:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040256 00000100:00100000:3.0:1788941065.375553:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788941065.375561:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839945040256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788941065.375579:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788941065.375599:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788941065.375680:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3647:x1875839945040256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 119us (1237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941065.375695:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941065.376045:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945040640:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376091:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376132:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945041152:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376155:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376174:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945041664:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376200:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376224:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788941065.376230:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376253:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376304:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945041280:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376325:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376339:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839945041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376362:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941065.376395:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040640 00000100:00100000:1.0:1788941065.376401:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040640 00000100:00100000:1.0:1788941065.376446:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041152 00000100:00100000:1.0:1788941065.376449:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041152 00000100:00100000:1.0:1788941065.376465:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941065.376473:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945040640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376526:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945040640:12345-0@lo:400:kworker.0 Request processed in 54us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376542:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788941065.376557:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941065.376563:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945041152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376589:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945041152:12345-0@lo:400:kworker.0 Request processed in 26us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376595:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788941065.376612:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041664 00000100:00100000:1.0:1788941065.376615:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041664 00000100:00100000:1.0:1788941065.376645:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041792 00000100:00100000:1.0:1788941065.376648:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041792 00000100:00100000:1.0:1788941065.376676:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941065.376683:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945041664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376723:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945041664:12345-0@lo:400:kworker.0 Request processed in 30us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376729:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788941065.376740:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788941065.376746:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839945041792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376770:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839945041792:12345-0@lo:400:kworker.0 Request processed in 25us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376776:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788941065.376792:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040768 00000100:00100000:1.0:1788941065.376796:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040768 00000100:00100000:1.0:1788941065.376815:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041280 00000100:00100000:1.0:1788941065.376818:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041280 00000100:00100000:1.0:1788941065.376830:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941065.376836:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945040768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376874:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945040768:12345-0@lo:400:kworker.0 Request processed in 39us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376881:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788941065.376890:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941065.376896:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945041280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376920:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945041280:12345-0@lo:400:kworker.0 Request processed in 24us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.376925:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788941065.376984:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945040768:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.376995:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945041280:0@lo:400:kworker.0 00010000:00080000:1.0:1788941065.377009:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d035a50700 x1875839945041792/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941065.377020:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839945041792:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.377030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945040640:0@lo:400:kworker.0 00000100:00100000:1.0:1788941065.377038:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945041152:0@lo:400:kworker.0 00010000:00080000:1.0:1788941065.377046:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd3b80 x1875839945041664/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788941065.377055:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945041664:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.380754:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945040896:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381068:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.381113:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945041408:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381143:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.381164:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945041920:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381186:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.381584:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945040256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941065.381616:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788941065.381624:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945040512:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381657:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.381919:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945041024:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381944:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.381966:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839945041536:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.381988:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.382006:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945042048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941065.382010:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040512 00000100:00100000:3.0:1788941065.382018:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040512 00000100:00100000:2.0:1788941065.382038:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941065.382072:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788941065.382073:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945040896 00000100:00100000:2.0:1788941065.382076:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945040896 00000100:00100000:3.0:1788941065.382082:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945040512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.382104:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788941065.382110:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945040896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.382596:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945040896:12345-0@lo:400:kworker.0 Request processed in 483us (1527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.382604:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788941065.382637:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941065.382642:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788941065.382646:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941065.382649:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941065.382909:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041408 00000100:00100000:2.0:1788941065.382915:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041408 00000100:00100000:2.0:1788941065.382938:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041920 00000100:00100000:2.0:1788941065.382942:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041920 00000100:00100000:2.0:1788941065.382966:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041024 00000100:00100000:2.0:1788941065.382969:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041024 00000100:00100000:2.0:1788941065.382979:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945041536 00000100:00100000:2.0:1788941065.382982:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945041536 00000100:00100000:2.0:1788941065.382996:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941065.383002:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945041408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941065.390560:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788941065.390587:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945041920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941065.396738:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945040512:12345-0@lo:400:kworker.0 Request processed in 14644us (15066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.396738:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945041408:12345-0@lo:400:kworker.0 Request processed in 13722us (15580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941065.396756:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788941065.396757:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788941065.398051:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941065.398069:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945041024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.398173:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945041024:12345-0@lo:400:kworker.0 Request processed in 111us (16228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.398182:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788941065.398196:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788941065.398204:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839945041536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.398236:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3647:x1875839945041536:12345-0@lo:400:kworker.0 Request processed in 33us (16247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.398242:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788941065.398405:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941065.398413:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941065.398466:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945040512:0@lo:400:kworker.0 00010000:00080000:2.0:1788941065.398488:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd3100 x1875839945041024/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941065.398526:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945041920:12345-0@lo:400:kworker.0 Request processed in 7950us (17337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.398535:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788941065.398574:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042048 00000100:00100000:0.0:1788941065.398584:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042048 00000100:00100000:2.0:1788941065.398624:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945041024:0@lo:400:kworker.0 00010000:00080000:2.0:1788941065.398639:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd2680 x1875839945041536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941065.398648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3647:1875839945041536:0@lo:400:kworker.0 00000100:00100000:2.0:1788941065.398664:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945040896:0@lo:400:kworker.0 00010000:00080000:2.0:1788941065.398913:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dd1500 x1875839945041408/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941065.398938:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945041408:0@lo:400:kworker.0 00010000:00080000:2.0:1788941065.398952:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afaa00 x1875839945041920/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941065.398961:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945041920:0@lo:400:kworker.0 00000100:00100000:0.0:1788941065.399400:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788941065.399410:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945042048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788941065.399436:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 896 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941065.401114:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945042048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1698us (19066us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.401237:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941065.405189:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00137b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945042048:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941065.429153:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23472:x1875839945040384:12345-0@lo:5:osp-pre-1-1.0 Request processed in 54513us (55532us total) trans 12884901890 rc 0/0 00000100:00100000:3.0:1788941065.429172:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788941065.429827:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23472:1875839945040384:0@lo:5:osp-pre-1-1.0 00000004:00080000:2.0:1788941065.429853:0:23472:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:2.0:1788941065.429923:0:23472:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875839945042176:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788941065.429982:0:23472:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941065.430029:0:23472:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d0207fb6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788941065.430115:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042176 00000100:00100000:0.0:1788941065.430124:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042176 00000100:00100000:0.0:1788941065.430184:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788941065.430195:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875839945042176:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788941065.430305:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23472:x1875839945042176:12345-0@lo:900:osp-pre-1-1.0 Request processed in 111us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.430328:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788941065.430409:0:23472:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf06100000 x1875839945042176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788941081 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941065.430423:0:23472:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06100000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23472:1875839945042176:0@lo:900:osp-pre-1-1.0 00000020:00000004:2.0:1788941065.453577:0:25509:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788941065.454196:0:25509:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788941065.848744:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941065.848870:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921835904 00000100:00100000:0.0:1788941065.848881:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921835904 00000100:00100000:0.0:1788941065.848981:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:0.0:1788941065.848991:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2403:x1875839921835904:12345-192.168.202.25@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788941065.849030:0:22721:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1db1d5c3-15ff-40cf-9be9-426f5189bac6@192.168.202.25@tcp t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:0.0:1788941065.849059:0:22721:0:(genops.c:1393:class_connect()) connect: client 1db1d5c3-15ff-40cf-9be9-426f5189bac6, cookie 0x9c34acc08badf011 00000100:00080000:0.0:1788941065.849209:0:22721:0:(import.c:65:import_set_state_nolock()) ffff91cf06def000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941065.849325:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+5:2403:x1875839921835904:12345-192.168.202.25@tcp:250:mount.lustre.0 Request processed in 333us (620us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.849333:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 118 00000100:00100000:3.0:1788941065.883527:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788941065.883552:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945042304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941065.883625:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941065.884996:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042304 00000100:00100000:0.0:1788941065.885009:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042304 00000100:00100000:0.0:1788941065.885079:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788941065.885089:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945042304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788941065.885121:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941065.885192:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945042304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (1568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.885199:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941065.885371:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945042304:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941065.887549:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941065.887635:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836032 00000100:00100000:2.0:1788941065.887644:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836032 00000100:00100000:2.0:1788941065.887697:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:2.0:1788941065.887715:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+5:18126:x1875839921836032:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788941065.887731:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941065.887748:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91cf060fb600/0x9c34acc08badf018 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77d1 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.887772:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91cf060fb600/0x9c34acc08badf018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77d1 expref: 6 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.887780:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91cf060fb600/0x9c34acc08badf018 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77d1 expref: 6 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.887798:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fb600, rc 0) 00000100:00100000:2.0:1788941065.887846:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+6:18126:x1875839921836032:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 142us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.887851:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 119 00000100:00100000:3.0:1788941065.893121:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941065.899183:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836160 00000100:00100000:0.0:1788941065.899200:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836160 00000100:00100000:1.0:1788941065.899558:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:1.0:1788941065.899570:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+6:18126:x1875839921836160:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788941065.899737:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+6:18126:x1875839921836160:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 169us (6625us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788941065.899746:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 120 00000100:00100000:3.0:1788941065.901644:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941065.902033:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836288 00000100:00100000:0.0:1788941065.902043:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836288 00000100:00100000:0.0:1788941065.902103:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:0.0:1788941065.902117:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+6:18126:x1875839921836288:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788941065.902134:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941065.902166:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584da00/0x9c34acc08badf01f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc77d8 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941065.902199:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584da00/0x9c34acc08badf01f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77d8 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941065.902211:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584da00/0x9c34acc08badf01f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc77d8 expref: 7 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941065.902219:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584da00, rc 0) 00000100:00100000:0.0:1788941065.902902:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+7:18126:x1875839921836288:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 786us (1262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.902911:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 121 00000100:00100000:3.0:1788941065.907136:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941065.907317:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836416 00000100:00100000:2.0:1788941065.907327:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836416 00000100:00100000:2.0:1788941065.907545:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:2.0:1788941065.907557:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+7:18126:x1875839921836416:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788941065.907870:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18126:x1875839921836416:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 314us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.907878:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 122 00000100:00100000:3.0:1788941065.913597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941065.915726:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836544 00000100:00100000:1.0:1788941065.915741:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836544 00000100:00100000:1.0:1788941065.915815:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:1.0:1788941065.915827:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18126:x1875839921836544:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788941065.915985:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035847850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18126:x1875839921836544:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 159us (2727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.915994:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 123 00000100:00100000:1.0:1788941065.926201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941065.926378:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836672 00000100:00100000:0.0:1788941065.926394:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836672 00000100:00100000:0.0:1788941065.926470:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:0.0:1788941065.926481:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836672:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941065.926651:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035844050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836672:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 172us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941065.926659:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 124 00000100:00100000:3.0:1788941065.953774:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941065.953892:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836800 00000100:00100000:2.0:1788941065.953908:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836800 00000100:00100000:2.0:1788941065.954042:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:2.0:1788941065.954054:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836800:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788941065.954228:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035847050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836800:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 175us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.954235:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 125 00000100:00100000:3.0:1788941065.974069:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941065.974301:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921836928 00000100:00100000:1.0:1788941065.974317:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921836928 00000100:00100000:1.0:1788941065.974411:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:1.0:1788941065.974424:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836928:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941065.974746:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035845c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18144:x1875839921836928:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 185us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941065.974755:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 126 00000100:00100000:1.0:1788941065.984681:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941065.984798:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837056 00000100:00100000:2.0:1788941065.984808:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837056 00000100:00100000:2.0:1788941065.984866:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:2.0:1788941065.984876:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+8:18126:x1875839921837056:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788941065.984894:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941065.984912:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91cf060fac00/0x9c34acc08badf026 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7809 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.984966:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91cf060fac00/0x9c34acc08badf026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7809 expref: 9 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.984979:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91cf060fac00/0x9c34acc08badf026 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7809 expref: 9 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941065.984988:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fac00, rc 0) 00000100:00100000:2.0:1788941065.985532:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035846850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+9:18126:x1875839921837056:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 654us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941065.985540:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 127 00000100:00100000:3.0:1788941066.001470:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.001613:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837184 00000100:00100000:0.0:1788941066.001622:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837184 00000100:00100000:0.0:1788941066.001666:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:0.0:1788941066.001674:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+9:18126:x1875839921837184:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788941066.001697:0:22719:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788941066.001728:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788941066.001733:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788941066.001736:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788941066.001746:0:22719:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788941066.001748:0:22719:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788941066.003982:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+9:18126:x1875839921837184:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 2299us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.003994:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 128 00000100:00100000:1.0:1788941066.008432:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941066.008529:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837312 00000100:00100000:2.0:1788941066.008539:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837312 00000100:00100000:2.0:1788941066.008624:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:2.0:1788941066.008635:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+9:18126:x1875839921837312:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788941066.008652:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941066.008669:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7810 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941066.008697:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941066.008721:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 10 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941066.008729:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fae00, rc 0) 00000100:00100000:2.0:1788941066.008824:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03788d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18126:x1875839921837312:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 191us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941066.008849:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 129 00000100:00100000:2.0:1788941066.015866:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.016511:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837440 00000100:00100000:0.0:1788941066.016525:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837440 00000100:00100000:0.0:1788941066.016580:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:0.0:1788941066.016591:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18126:x1875839921837440:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788941066.016767:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18126:x1875839921837440:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 177us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.016775:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 130 00000100:00100000:3.0:1788941066.019354:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941066.019476:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837568 00000100:00100000:2.0:1788941066.019486:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837568 00000100:00100000:2.0:1788941066.019540:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:2.0:1788941066.019553:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18126:x1875839921837568:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788941066.019701:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18126:x1875839921837568:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 153us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941066.019720:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 131 00000100:00100000:3.0:1788941066.024946:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941066.025076:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837696 00000100:00100000:1.0:1788941066.025086:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837696 00000100:00100000:1.0:1788941066.025168:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:1.0:1788941066.025179:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18149:x1875839921837696:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941066.025383:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18149:x1875839921837696:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 205us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.025397:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 132 00000100:00100000:3.0:1788941066.032651:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.032963:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837824 00000100:00100000:0.0:1788941066.032974:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837824 00000100:00100000:0.0:1788941066.033052:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:0.0:1788941066.033062:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18149:x1875839921837824:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941066.033246:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18149:x1875839921837824:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 184us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.033291:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 133 00000100:00100000:3.0:1788941066.046779:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941066.046901:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.047024:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921837952 00000100:00100000:0.0:1788941066.047045:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921837952 00000100:00100000:2.0:1788941066.047086:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838208 00000100:00100000:2.0:1788941066.047097:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838208 00000100:00100000:0.0:1788941066.047194:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788941066.047204:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875839921837952:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788941066.047235:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:0.0:1788941066.047328:0:22727:0:(genops.c:1393:class_connect()) connect: client 0a59a807-509a-4dc3-9d2e-9cc836e430e2, cookie 0x9c34acc08badf034 00000004:00100000:0.0:1788941066.047353:0:22727:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788941066.051744:0:22727:0:(import.c:65:import_set_state_nolock()) ffff91cf06dec000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941066.051906:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2403:x1875839921837952:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 4696us (5139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.051917:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788941066.051957:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:0.0:1788941066.051964:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2403:x1875839921838208:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788941066.051991:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:0.0:1788941066.052040:0:22727:0:(genops.c:1393:class_connect()) connect: client 0a59a807-509a-4dc3-9d2e-9cc836e430e2, cookie 0x9c34acc08badf03b 00000004:00100000:0.0:1788941066.052065:0:22727:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:0.0:1788941066.052307:0:22727:0:(import.c:65:import_set_state_nolock()) ffff91cf06de8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941066.052335:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2403:x1875839921838208:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 369us (5433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.052342:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:3.0:1788941066.073096:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941066.073149:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.074082:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838464 00000100:00100000:0.0:1788941066.074096:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838464 00000100:00100000:0.0:1788941066.074184:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838336 00000100:00100000:0.0:1788941066.074188:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838336 00000100:00100000:0.0:1788941066.074219:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788941066.074231:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838464:12345-192.168.202.25@tcp:41:mount.lustre.0 00000100:00080000:2.0:1788941066.074491:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941066.074498:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1788941066.074929:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941066.075056:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838464:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 826us (1974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.075068:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788941066.075095:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:0.0:1788941066.075103:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:0:x1875839921838336:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788941066.075147:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941066.075189:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:0:x1875839921838336:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 87us (2039us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.075195:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:3.0:1788941066.076236:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941066.076365:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838080 00000100:00100000:1.0:1788941066.076382:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838080 00000100:00100000:1.0:1788941066.076466:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:1.0:1788941066.076477:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:0:x1875839921838080:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788941066.076512:0:22728:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941066.076584:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:0:x1875839921838080:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 108us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.076592:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00010000:00010000:3.0:1788941066.076680:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941066.081008:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.081501:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838592 00000100:00100000:0.0:1788941066.081517:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838592 00000100:00100000:0.0:1788941066.081599:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1788941066.081612:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838592:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788941066.081747:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838592:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 136us (1488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.081755:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1788941066.094001:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941066.095125:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838720 00000100:00100000:0.0:1788941066.095142:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838720 00000100:00100000:0.0:1788941066.095210:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788941066.095220:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2403:x1875839921838720:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788941066.095508:0:24236:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp t0 exp 0000000000000000 cur 821 last 0 00000020:00000080:0.0:1788941066.095591:0:24236:0:(genops.c:1393:class_connect()) connect: client 0a59a807-509a-4dc3-9d2e-9cc836e430e2, cookie 0x9c34acc08badf042 00002000:00100000:0.0:1788941066.095610:0:24236:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a59a807-509a-4dc3-9d2e-9cc836e430e2/ffff91d00b27b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788941066.095625:0:24236:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00000100:00100000:2.0:1788941066.096015:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941066.096125:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941066.096307:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838848 00000100:00100000:1.0:1788941066.096324:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838848 00000100:00100000:1.0:1788941066.096511:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:1.0:1788941066.096522:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2403:x1875839921838848:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788941066.096562:0:24235:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp t0 exp 0000000000000000 cur 821 last 0 00000100:00100000:3.0:1788941066.096595:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921838976 00000020:00000080:1.0:1788941066.096599:0:24235:0:(genops.c:1393:class_connect()) connect: client 0a59a807-509a-4dc3-9d2e-9cc836e430e2, cookie 0x9c34acc08badf049 00000100:00100000:3.0:1788941066.096604:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921838976 00000100:00100000:3.0:1788941066.096661:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1788941066.096675:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838976:12345-192.168.202.25@tcp:900:mount.lustre.0 00002000:00100000:1.0:1788941066.096766:0:24235:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a59a807-509a-4dc3-9d2e-9cc836e430e2/ffff91d040a6f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1788941066.096799:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921838976:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 121us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941066.096809:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00002000:00100000:1.0:1788941066.097152:0:24235:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788941066.097749:0:24236:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788941066.097869:0:24236:0:(import.c:65:import_set_state_nolock()) ffff91d00b27c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941066.097947:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2403:x1875839921838720:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 2727us (3963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.097958:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00002000:00080000:1.0:1788941066.098993:0:24235:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788941066.100516:0:24235:0:(import.c:65:import_set_state_nolock()) ffff91d040a6b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941066.101758:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06100000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2403:x1875839921838848:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 5166us (5674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.101772:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000001:00100000:2.0:1788941066.111315:0:25052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a59a807-509a-4dc3-9d2e-9cc836e430e2 00000001:00080000:2.0:1788941066.111333:0:25052:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000100:00100000:2.0:1788941066.119378:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941066.119556:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839104 00000100:00100000:1.0:1788941066.119574:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839104 00000100:00100000:1.0:1788941066.119682:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1788941066.119714:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921839104:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788941066.136690:0:22730:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16883us 00000004:00200000:1.0:1788941066.156568:0:22730:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788941066.156763:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18126:x1875839921839104:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 37066us (37397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.156775:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:2.0:1788941066.427804:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941066.427981:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839232 00000100:00100000:1.0:1788941066.427998:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839232 00000100:00100000:1.0:1788941066.428076:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1788941066.428089:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18172:x1875839921839232:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:1.0:1788941066.428121:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941066.428157:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badf050 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7841 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428530:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428550:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428569:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941066.428636:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788941066.428641:0:22729:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941066.428710:0:22729:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428746:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218600/0x9c34acc08badf050 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7841 expref: 8 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428862:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7841 expref: 7 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941066.428874:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:1.0:1788941066.428878:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941066.428882:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219400, rc 0) 00000100:00100000:1.0:1788941066.428987:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18172:x1875839921839232:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 900us (1206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.428995:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1788941066.907957:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941066.907989:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945042432:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941066.908091:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941066.908478:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042432 00000100:00100000:1.0:1788941066.908490:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042432 00000100:00100000:1.0:1788941066.908561:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788941066.908574:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945042432:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941066.908624:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941066.908689:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00137b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945042432:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941066.908710:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788941066.908768:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945042432:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941066.911871:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf06f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945042560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788941066.911975:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941066.913790:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945042688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941066.913895:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941066.914135:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042688 00000100:00100000:3.0:1788941066.914147:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042688 00000100:00100000:3.0:1788941066.914209:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788941066.914221:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945042688:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941066.914304:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941066.914361:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945042688:12345-0@lo:41:osp-pre-1-0.0 Request processed in 143us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941066.914370:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788941066.914520:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042560 00000100:00100000:0.0:1788941066.914526:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042560 00000100:00100000:0.0:1788941066.914567:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788941066.914575:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945042560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788941066.914593:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941066.914635:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945042560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (2661us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941066.914642:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788941066.915842:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945042688:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941066.915899:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf06f64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945042560:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788941067.099507:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941068.180464:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941068.545715:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941068.546054:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839360 00000100:00100000:0.0:1788941068.546066:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839360 00000100:00100000:0.0:1788941068.546150:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1788941068.546161:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18225:x1875839921839360:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:0.0:1788941068.546200:0:24594:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788941068.546334:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18225:x1875839921839360:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 174us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941068.546343:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00080000:2.0:1788941068.548366:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788941068.550050:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941068.550144:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839488 00000100:00100000:0.0:1788941068.550155:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839488 00000100:00100000:0.0:1788941068.550304:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1788941068.550316:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18225:x1875839921839488:12345-192.168.202.25@tcp:41:lfs.0 00000004:00000024:0.0:1788941068.550356:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941068.550450:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18225:x1875839921839488:12345-192.168.202.25@tcp:41:lfs.0 Request processed in 136us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941068.550474:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:3.0:1788941068.558392:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00080000:2.0:1788941068.561917:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788941068.562395:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839616 00000100:00100000:0.0:1788941068.562407:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839616 00000100:00100000:0.0:1788941068.562493:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1788941068.562503:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18225:x1875839921839616:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:0.0:1788941068.562536:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941068.562632:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18225:x1875839921839616:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 130us (4254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941068.562649:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00080000:2.0:1788941068.563459:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941068.565441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941068.565555:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839744 00000100:00100000:0.0:1788941068.565568:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839744 00000100:00100000:0.0:1788941068.565668:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:0.0:1788941068.565679:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18225:x1875839921839744:12345-192.168.202.25@tcp:13:lfs.0 00002000:00000024:0.0:1788941068.565723:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:2.0:1788941068.565962:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788941068.566118:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18225:x1875839921839744:12345-192.168.202.25@tcp:13:lfs.0 Request processed in 440us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941068.566127:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788941068.831092:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941068.831797:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921839872 00000100:00100000:2.0:1788941068.831810:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921839872 00000100:00100000:2.0:1788941068.831880:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:2.0:1788941068.831891:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+10:18257:x1875839921839872:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788941068.831910:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941068.832092:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91cf060fb400/0x9c34acc08badf05e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7848 expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941068.832238:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91cf060fb400/0x9c34acc08badf05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7848 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941068.832345:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91cf060fb400/0x9c34acc08badf05e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7848 expref: 11 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941068.832355:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fb400, rc 0) 00000100:00100000:2.0:1788941068.833181:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921839872:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 1288us (2095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941068.833190:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 134 00000100:00100000:2.0:1788941068.880147:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941068.880466:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840000 00000100:00100000:1.0:1788941068.880477:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840000 00000100:00100000:1.0:1788941068.880537:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:1.0:1788941068.880548:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921840000:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788941068.880734:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035890450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921840000:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 187us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941068.880742:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 135 00000100:00100000:3.0:1788941068.913998:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941068.917483:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840128 00000100:00100000:2.0:1788941068.917499:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840128 00000100:00100000:2.0:1788941068.917577:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:2.0:1788941068.917588:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921840128:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788941068.917766:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035892c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921840128:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 178us (3777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941068.917774:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 136 00000100:00100000:2.0:1788941068.927596:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941068.927909:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840256 00000100:00100000:0.0:1788941068.927923:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840256 00000100:00100000:0.0:1788941068.927997:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:0.0:1788941068.928008:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840256:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941068.928186:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840256:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 179us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941068.928195:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 137 00000100:00100000:3.0:1788941068.981850:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941068.981984:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840384 00000100:00100000:1.0:1788941068.981994:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840384 00000100:00100000:1.0:1788941068.982051:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:1.0:1788941068.982062:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840384:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941068.982299:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840384:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 195us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941068.982309:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 138 00000100:00100000:3.0:1788941068.992801:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941068.993292:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840512 00000100:00100000:1.0:1788941068.993304:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840512 00000100:00100000:1.0:1788941068.993401:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:1.0:1788941068.993414:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840512:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788941068.993568:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035891850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18265:x1875839921840512:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 157us (776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941068.993576:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 139 00000100:00100000:2.0:1788941069.000571:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941069.000673:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840640 00000100:00100000:0.0:1788941069.000705:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840640 00000100:00100000:0.0:1788941069.000761:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:0.0:1788941069.000772:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18257:x1875839921840640:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788941069.000791:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941069.000809:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d03584ce00/0x9c34acc08badf065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7879 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.000854:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d03584ce00/0x9c34acc08badf065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7879 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.000867:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d03584ce00/0x9c34acc08badf065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7879 expref: 12 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.000877:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ce00, rc 0) 00000100:00100000:0.0:1788941069.000950:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035893050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18257:x1875839921840640:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 180us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.000958:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 140 00000100:00100000:2.0:1788941069.008661:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941069.008911:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840768 00000100:00100000:1.0:1788941069.008933:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840768 00000100:00100000:1.0:1788941069.008994:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:1.0:1788941069.009005:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18257:x1875839921840768:12345-192.168.202.25@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788941069.009033:0:22722:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788941069.009057:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788941069.009062:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788941069.009065:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788941069.009073:0:22722:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788941069.009075:0:22722:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:1.0:1788941069.013313:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18257:x1875839921840768:12345-192.168.202.25@tcp:256:mount.lustre.0 Request processed in 4298us (4650us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941069.013329:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 141 00000100:00100000:2.0:1788941069.019915:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941069.020069:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921840896 00000100:00100000:3.0:1788941069.020090:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921840896 00000100:00100000:3.0:1788941069.020466:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:3.0:1788941069.020481:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18257:x1875839921840896:12345-192.168.202.25@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788941069.020499:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941069.020518:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7880 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941069.020549:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941069.020562:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941069.020572:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d035937000, rc 0) 00000100:00100000:3.0:1788941069.020631:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18257:x1875839921840896:12345-192.168.202.25@tcp:101:mount.lustre.0 Request processed in 156us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941069.028217:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 142 00000100:00100000:2.0:1788941069.028696:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.028749:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841024 00000100:00100000:2.0:1788941069.028759:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841024 00000100:00100000:2.0:1788941069.028799:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:2.0:1788941069.028807:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18257:x1875839921841024:12345-192.168.202.25@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788941069.028987:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18257:x1875839921841024:12345-192.168.202.25@tcp:501:mount.lustre.0 Request processed in 179us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.028996:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 143 00000100:00100000:2.0:1788941069.035524:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941069.035689:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841152 00000100:00100000:1.0:1788941069.035703:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841152 00000100:00100000:1.0:1788941069.035769:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:1.0:1788941069.035779:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18257:x1875839921841152:12345-192.168.202.25@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788941069.035941:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18257:x1875839921841152:12345-192.168.202.25@tcp:503:mount.lustre.0 Request processed in 163us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941069.035950:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 144 00000100:00100000:3.0:1788941069.040933:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941069.041038:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841280 00000100:00100000:0.0:1788941069.041049:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841280 00000100:00100000:0.0:1788941069.041120:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:0.0:1788941069.041131:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18270:x1875839921841280:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788941069.041330:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18270:x1875839921841280:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 200us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.041338:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 145 00000100:00100000:3.0:1788941069.050075:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.050417:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841408 00000100:00100000:2.0:1788941069.050430:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841408 00000100:00100000:2.0:1788941069.050503:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:2.0:1788941069.050514:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18270:x1875839921841408:12345-192.168.202.25@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788941069.050672:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18270:x1875839921841408:12345-192.168.202.25@tcp:502:llog_process_th.0 Request processed in 158us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.050699:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 146 00000100:00100000:2.0:1788941069.078408:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078455:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078487:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078507:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078531:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078556:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.078586:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842432 00000100:00100000:2.0:1788941069.078597:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842432 00000100:00100000:2.0:1788941069.078643:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842560 00000100:00100000:2.0:1788941069.078646:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842560 00000100:00100000:2.0:1788941069.078666:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788941069.078686:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921842432:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788941069.078758:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921842432:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 83us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.078766:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:2.0:1788941069.078784:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:2.0:1788941069.078791:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921842560:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:2.0:1788941069.078838:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921842560:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 48us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.078844:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:2.0:1788941069.078867:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841536 00000100:00100000:3.0:1788941069.079107:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841792 00000100:00100000:3.0:1788941069.079122:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841792 00000100:00100000:3.0:1788941069.079156:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842176 00000100:00100000:3.0:1788941069.079160:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842176 00000100:00100000:1.0:1788941069.079167:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842304 00000100:00100000:1.0:1788941069.079176:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842304 00000100:00100000:3.0:1788941069.079198:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:3.0:1788941069.079225:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2405:x1875839921842176:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788941069.079339:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2405:x1875839921842176:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 117us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.079350:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841536 00000100:00100000:1.0:1788941069.092462:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:1.0:1788941069.092489:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921842304:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941069.092574:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921842304:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 100us (14042us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941069.092582:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:1.0:1788941069.092604:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1788941069.092609:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2403:x1875839921841792:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788941069.092637:0:24594:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from a21cd3f3-8c72-4460-9f1e-22e6666edfab@192.168.202.25@tcp t0 exp 0000000000000000 cur 824 last 0 00000020:00000080:1.0:1788941069.092685:0:24594:0:(genops.c:1393:class_connect()) connect: client a21cd3f3-8c72-4460-9f1e-22e6666edfab, cookie 0x9c34acc08badf073 00000004:00100000:1.0:1788941069.092710:0:24594:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return b7 00000100:00080000:1.0:1788941069.092798:0:24594:0:(import.c:65:import_set_state_nolock()) ffff91cf07be3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788941069.092838:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2403:x1875839921841792:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 227us (14382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941069.092846:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:3.0:1788941069.099926:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1788941069.102044:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:2.0:1788941069.102089:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2403:x1875839921841536:12345-192.168.202.25@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788941069.102169:0:22729:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from a21cd3f3-8c72-4460-9f1e-22e6666edfab@192.168.202.25@tcp t0 exp 0000000000000000 cur 824 last 0 00000020:00000080:2.0:1788941069.102219:0:22729:0:(genops.c:1393:class_connect()) connect: client a21cd3f3-8c72-4460-9f1e-22e6666edfab, cookie 0x9c34acc08badf07a 00000004:00100000:2.0:1788941069.102547:0:22729:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return b7 00000100:00080000:2.0:1788941069.102656:0:22729:0:(import.c:65:import_set_state_nolock()) ffff91cf08dfe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788941069.102744:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2403:x1875839921841536:12345-192.168.202.25@tcp:38:mount.lustre.0 Request processed in 656us (24345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941069.103067:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941069.103113:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841920 00000100:00100000:3.0:1788941069.103125:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841920 00000100:00080000:0.0:1788941069.103916:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941069.114576:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:0.0:1788941069.118590:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:0.0:1788941069.118612:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:0:x1875839921841920:12345-192.168.202.25@tcp:41:mount.lustre.0 00000100:00100000:1.0:1788941069.118626:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000004:00000024:0.0:1788941069.118685:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788941069.118769:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:0:x1875839921841920:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 162us (15705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941069.118774:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842048 00000100:00100000:0.0:1788941069.118785:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:3.0:1788941069.118793:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842048 00000100:00080000:0.0:1788941069.118854:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788941069.118885:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:3.0:1788941069.118896:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921842048:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788941069.118934:0:24594:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941069.119017:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921842048:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 122us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941069.119025:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1788941069.121881:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941069.122119:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921841664 00000100:00100000:2.0:1788941069.122134:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921841664 00000100:00100000:2.0:1788941069.122206:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1788941069.122217:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:0:x1875839921841664:12345-192.168.202.25@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788941069.122303:0:22727:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788941069.122406:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:0:x1875839921841664:12345-192.168.202.25@tcp:41:mount.lustre.0 Request processed in 190us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.122414:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:1.0:1788941069.136612:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941069.139865:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842688 00000100:00100000:3.0:1788941069.139882:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842688 00000100:00100000:2.0:1788941069.140185:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:2.0:1788941069.140209:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921842688:12345-192.168.202.25@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788941069.140656:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921842688:12345-192.168.202.25@tcp:40:mount.lustre.0 Request processed in 454us (4054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941069.140666:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:3.0:1788941069.146217:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941069.146425:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941069.146458:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941069.146684:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842816 00000100:00100000:0.0:1788941069.146702:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842816 00000100:00100000:2.0:1788941069.146715:0:22739:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843072 00000100:00100000:2.0:1788941069.146728:0:22739:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843072 00000100:00100000:0.0:1788941069.146771:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921842944 00000100:00100000:0.0:1788941069.146777:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921842944 00000100:00100000:2.0:1788941069.146800:0:22739:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1788941069.146826:0:22739:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921843072:12345-192.168.202.25@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788941069.146826:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788941069.146841:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875839921842816:12345-192.168.202.25@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788941069.146880:0:24595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from a21cd3f3-8c72-4460-9f1e-22e6666edfab@192.168.202.25@tcp t0 exp 0000000000000000 cur 824 last 0 00000020:00000080:0.0:1788941069.146923:0:24595:0:(genops.c:1393:class_connect()) connect: client a21cd3f3-8c72-4460-9f1e-22e6666edfab, cookie 0x9c34acc08badf081 00002000:00100000:0.0:1788941069.146936:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli a21cd3f3-8c72-4460-9f1e-22e6666edfab/ffff91d00b27d000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788941069.146948:0:24595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788941069.147021:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788941069.147057:0:24595:0:(import.c:65:import_set_state_nolock()) ffff91d00b27f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941069.147134:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2403:x1875839921842816:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 295us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.147143:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788941069.147162:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:2.0:1788941069.147171:0:22739:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921843072:12345-192.168.202.25@tcp:900:mount.lustre.0 Request processed in 155us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.147171:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2403:x1875839921842944:12345-192.168.202.25@tcp:8:mount.lustre.0 00000100:00100000:2.0:1788941069.147194:0:22739:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00010000:00080000:0.0:1788941069.147202:0:24595:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from a21cd3f3-8c72-4460-9f1e-22e6666edfab@192.168.202.25@tcp t0 exp 0000000000000000 cur 824 last 0 00000020:00000080:0.0:1788941069.147225:0:24595:0:(genops.c:1393:class_connect()) connect: client a21cd3f3-8c72-4460-9f1e-22e6666edfab, cookie 0x9c34acc08badf088 00002000:00100000:0.0:1788941069.150203:0:24595:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli a21cd3f3-8c72-4460-9f1e-22e6666edfab/ffff91d00b27a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788941069.150219:0:24595:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return b7 00002000:00080000:0.0:1788941069.150349:0:24595:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788941069.150392:0:24595:0:(import.c:65:import_set_state_nolock()) ffff91d00b27b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788941069.150886:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2403:x1875839921842944:12345-192.168.202.25@tcp:8:mount.lustre.0 Request processed in 3715us (4425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.150898:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:3.0:1788941069.151369:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941069.151569:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843200 00000100:00100000:1.0:1788941069.151578:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843200 00000100:00100000:1.0:1788941069.151625:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:1.0:1788941069.151635:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921843200:12345-192.168.202.25@tcp:33:mount.lustre.0 00000004:00200000:1.0:1788941069.151776:0:22731:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788941069.151831:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18257:x1875839921843200:12345-192.168.202.25@tcp:33:mount.lustre.0 Request processed in 199us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941069.151839:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00010000:00010000:1.0:1788941069.215883:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941069.338634:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941069.338826:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843328 00000100:00100000:0.0:1788941069.338842:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843328 00000100:00100000:0.0:1788941069.338975:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788941069.338988:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18293:x1875839921843328:12345-192.168.202.25@tcp:101:mkdir.0 00010000:00010000:0.0:1788941069.339018:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941069.339056:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf08f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78b1 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339145:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339164:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339190:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941069.339324:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788941069.339328:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941069.339532:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339607:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf08f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 8 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339630:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 7 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941069.339640:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:0.0:1788941069.339643:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941069.339648:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1c00, rc 0) 00000100:00100000:0.0:1788941069.340517:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+7:18293:x1875839921843328:12345-192.168.202.25@tcp:101:mkdir.0 Request processed in 1524us (1888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941069.340532:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:0.0:1788941070.237848:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941070.493470:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941070.493563:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.493675:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042816 00000100:00100000:2.0:1788941070.493687:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042816 00000100:00100000:2.0:1788941070.493758:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788941070.493768:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945042816:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788941070.493805:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941070.493854:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945042816:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.493861:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:2.0:1788941070.493891:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788941070.493927:0:3645:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788941070.493955:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945042816:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941070.494528:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945042944:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.494571:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.494639:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945043072:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.494678:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.494718:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043072 00000100:00100000:2.0:1788941070.494724:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043072 00000100:00100000:2.0:1788941070.494763:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788941070.494771:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945043072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.494831:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945043072:12345-0@lo:400:kworker.0 Request processed in 61us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.494838:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788941070.494874:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945043072:0@lo:400:kworker.0 00000100:00100000:1.0:1788941070.495049:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945042944 00000100:00100000:1.0:1788941070.495055:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945042944 00000100:00100000:1.0:1788941070.495091:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788941070.495098:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:3646:x1875839945042944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941070.495140:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:3646:x1875839945042944:12345-0@lo:400:kworker.0 Request processed in 42us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941070.495146:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788941070.495184:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945042944:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495456:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941070.495467:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945043200:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495498:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.495529:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043200 00000100:00100000:2.0:1788941070.495533:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043200 00000100:00100000:2.0:1788941070.495571:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941070.495578:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945043200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495616:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945043200:12345-0@lo:400:kworker.0 Request processed in 38us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.495623:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788941070.495641:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941070.495660:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945043200:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495709:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945043328:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495735:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.495762:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043328 00000100:00100000:2.0:1788941070.495765:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043328 00000100:00100000:2.0:1788941070.495793:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941070.495798:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945043328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.495833:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945043328:12345-0@lo:400:kworker.0 Request processed in 34us (98us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.495840:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788941070.495873:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788941070.495892:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03588d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945043328:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496162:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496197:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941070.496219:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945044096:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496246:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941070.496286:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788941070.496301:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945043712:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496327:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941070.496343:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945044224:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496365:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941070.496394:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043712 00000100:00100000:3.0:1788941070.496398:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043712 00000100:00100000:3.0:1788941070.496434:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788941070.496442:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945043712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496477:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945043712:12345-0@lo:400:kworker.0 Request processed in 37us (150us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941070.496484:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788941070.496512:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945043712:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496541:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044096 00000100:00100000:3.0:1788941070.496544:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044096 00000100:00100000:3.0:1788941070.496574:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044224 00000100:00100000:3.0:1788941070.496577:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044224 00000100:00100000:3.0:1788941070.496599:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788941070.496605:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945044096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496642:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945044096:12345-0@lo:400:kworker.0 Request processed in 37us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941070.496649:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788941070.496673:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788941070.496681:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945044224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.496710:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945044224:12345-0@lo:400:kworker.0 Request processed in 31us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941070.496715:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:3.0:1788941070.496743:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941070.496746:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788941070.496749:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941070.496770:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945044224:0@lo:400:kworker.0 00010000:00080000:3.0:1788941070.496784:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dcc700 x1875839945044096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941070.496795:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945044096:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497025:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945043840:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497060:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.497085:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945044352:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497107:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.497124:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788941070.497130:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945043456:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497170:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.497186:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497208:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.497241:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043840 00000100:00100000:2.0:1788941070.497245:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043840 00000100:00100000:2.0:1788941070.497277:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044352 00000100:00100000:2.0:1788941070.497280:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044352 00000100:00100000:2.0:1788941070.497298:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043456 00000100:00100000:2.0:1788941070.497301:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043456 00000100:00100000:2.0:1788941070.497311:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043968 00000100:00100000:2.0:1788941070.497312:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043968 00000100:00100000:2.0:1788941070.497325:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788941070.497331:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945043840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497365:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03588d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945043840:12345-0@lo:400:kworker.0 Request processed in 35us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.497371:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788941070.497384:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788941070.497390:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839945044352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497416:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839945044352:12345-0@lo:400:kworker.0 Request processed in 27us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.497428:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788941070.497441:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788941070.497446:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945043456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497478:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3645:x1875839945043456:12345-0@lo:400:kworker.0 Request processed in 31us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.497483:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788941070.497494:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788941070.497500:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945043968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497529:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945043968:12345-0@lo:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.497534:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788941070.497550:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941070.497553:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788941070.497570:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3645:1875839945043456:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497580:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945043968:0@lo:400:kworker.0 00000100:00100000:2.0:1788941070.497589:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945043840:0@lo:400:kworker.0 00010000:00080000:2.0:1788941070.497599:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91cf08dced80 x1875839945044352/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788941070.497609:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945044352:0@lo:400:kworker.0 00000100:00100000:1.0:1788941070.497759:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945043584 00000100:00100000:1.0:1788941070.497764:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945043584 00000100:00100000:1.0:1788941070.497797:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788941070.497806:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945043584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941070.497862:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945043584:12345-0@lo:400:kworker.0 Request processed in 58us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941070.497869:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788941070.497932:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945043584:0@lo:400:kworker.0 00000100:00100000:3.0:1788941070.498546:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945044480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941070.498589:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941070.498996:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044480 00000100:00100000:2.0:1788941070.499005:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044480 00000100:00100000:2.0:1788941070.499054:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788941070.499064:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945044480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788941070.499105:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941070.507747:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945044480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8666us (9138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941070.507771:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788941070.510327:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945044480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941071.004246:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941071.004297:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945044608:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941071.004393:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941071.004984:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044608 00000100:00100000:1.0:1788941071.004994:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044608 00000100:00100000:1.0:1788941071.005064:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788941071.005077:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945044608:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788941071.005121:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788941071.005198:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945044608:12345-0@lo:13:osp-pre-0-1.0 Request processed in 123us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941071.005206:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788941071.005341:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945044608:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788941071.264452:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788941071.517848:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of a21cd3f3-8c72-4460-9f1e-22e6666edfab 00000001:00100000:1.0:1788941071.517866:0:22707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a59a807-509a-4dc3-9d2e-9cc836e430e2 00000001:00100000:0.0:1788941071.519336:0:23461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of a21cd3f3-8c72-4460-9f1e-22e6666edfab 00000001:00100000:0.0:1788941071.519349:0:23461:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0a59a807-509a-4dc3-9d2e-9cc836e430e2 00000001:00100000:1.0:1788941071.519880:0:24231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of a21cd3f3-8c72-4460-9f1e-22e6666edfab 00000001:00100000:1.0:1788941071.519888:0:24231:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a59a807-509a-4dc3-9d2e-9cc836e430e2 00000100:00100000:0.0:1788941072.027579:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788941072.027613:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945044736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941072.027887:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941072.028673:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945044992:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788941072.028740:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941072.028848:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945044864:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788941072.028900:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941072.028957:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044864 00000100:00100000:0.0:1788941072.028980:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044864 00000100:00100000:0.0:1788941072.029066:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941072.029079:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945044864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788941072.029533:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941072.029618:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945044864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 541us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941072.029627:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941072.029701:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945044864:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788941072.029746:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941072.040590:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044736 00000100:00100000:1.0:1788941072.040611:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044736 00000100:00100000:0.0:1788941072.043912:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945044992 00000100:00100000:0.0:1788941072.043931:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945044992 00000100:00100000:1.0:1788941072.046233:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788941072.046277:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945044736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941072.046337:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788941072.046585:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945044736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 338us (18698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941072.046594:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788941072.046618:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788941072.046643:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945044992:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788941072.046699:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788941072.046745:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945044992:12345-0@lo:41:osp-pre-1-0.0 Request processed in 105us (18004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941072.046751:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788941072.052057:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945044736:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941072.053900:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945044992:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788941072.284346:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941072.804170:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:2.0:1788941072.982968:0:25607:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788941073.308387:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788941074.216875:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.216984:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217016:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217054:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217079:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217103:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217135:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217152:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217211:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941074.217240:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843840 00000100:00100000:2.0:1788941074.217251:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843840 00000100:00100000:2.0:1788941074.217332:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843968 00000100:00100000:2.0:1788941074.217336:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843968 00000100:00100000:2.0:1788941074.217348:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844352 00000100:00100000:2.0:1788941074.217351:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844352 00000100:00100000:2.0:1788941074.217363:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844480 00000100:00100000:2.0:1788941074.217375:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844480 00000100:00100000:2.0:1788941074.217395:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788941074.217404:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2407:x1875839921843840:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217544:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843584 00000100:00100000:1.0:1788941074.217550:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843584 00000100:00100000:1.0:1788941074.217576:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843712 00000100:00100000:1.0:1788941074.217578:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843712 00000100:00100000:1.0:1788941074.217590:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844096 00000100:00100000:1.0:1788941074.217592:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844096 00000100:00100000:1.0:1788941074.217601:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844224 00000100:00100000:1.0:1788941074.217603:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844224 00000100:00100000:1.0:1788941074.217618:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1788941074.217624:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2407:x1875839921843584:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217698:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2407:x1875839921843584:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 73us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217705:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:1.0:1788941074.217722:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1788941074.217728:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2406:x1875839921843712:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217750:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2406:x1875839921843712:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217755:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1788941074.217766:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1788941074.217771:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2407:x1875839921844096:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217792:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2407:x1875839921844096:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 21us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217804:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:1.0:1788941074.217817:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788941074.217822:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2406:x1875839921844224:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217845:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2406:x1875839921844224:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217851:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:1.0:1788941074.217871:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788941074.217877:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d02bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2406:x1875839921843968:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217898:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d02bba1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2406:x1875839921843968:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217904:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788941074.217917:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1788941074.217922:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2407:x1875839921844352:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217940:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2407:x1875839921844352:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 18us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217946:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:1.0:1788941074.217955:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788941074.217960:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2406:x1875839921844480:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941074.217979:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2406:x1875839921844480:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941074.217983:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00080000:1.0:1788941074.218016:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788941074.218025:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788941074.218028:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788941074.218030:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941074.219609:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2407:x1875839921843840:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 2195us (2543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941074.219621:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:0.0:1788941074.232249:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921843456 00000100:00100000:0.0:1788941074.232292:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921843456 00000100:00100000:0.0:1788941074.232357:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 148 00000100:00100000:0.0:1788941074.232368:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:2406:x1875839921843456:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941074.232456:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:2406:x1875839921843456:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 89us (15590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941074.232463:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 148 00010000:00010000:0.0:1788941074.332332:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788941074.589698:0:25052:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of a21cd3f3-8c72-4460-9f1e-22e6666edfab 00000040:00080000:2.0:1788941074.781901:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788941075.355811:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788941075.611726:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945045120:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941075.611811:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.612388:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945045248:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.612438:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.612492:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045248 00000100:00100000:0.0:1788941075.612498:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045248 00000100:00100000:0.0:1788941075.612744:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788941075.612754:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:3648:x1875839945045248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.612815:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:3648:x1875839945045248:12345-0@lo:400:kworker.0 Request processed in 62us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.612837:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788941075.612890:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:66773969-0b9c-4025-866a-db20e971736d:3648:1875839945045248:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.613252:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945045376:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.613713:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.613740:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941075.613748:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945045504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941075.613876:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045376 00000100:00100000:2.0:1788941075.613882:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045376 00000100:00100000:2.0:1788941075.613927:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788941075.613937:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945045376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941075.613992:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945045376:12345-0@lo:400:kworker.0 Request processed in 58us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941075.613999:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941075.614170:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045120 00000100:00100000:1.0:1788941075.614175:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045120 00000100:00100000:1.0:1788941075.614216:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788941075.614223:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945045120:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788941075.614246:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788941075.614656:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945045120:12345-0@lo:13:osp-pre-1-1.0 Request processed in 432us (2843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941075.614664:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:1.0:1788941075.614698:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941075.614771:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788941075.614880:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.614915:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d03475fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945045376:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.615123:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045504 00000100:00100000:0.0:1788941075.615128:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045504 00000100:00100000:1.0:1788941075.615198:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945045888:0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.615232:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941075.615289:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045888 00000100:00100000:1.0:1788941075.615293:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045888 00000100:00100000:1.0:1788941075.615326:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941075.615346:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945045888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.615408:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945045888:12345-0@lo:400:kworker.0 Request processed in 75us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941075.615415:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788941075.615453:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945045888:0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.615500:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945046016:0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.615526:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.615648:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788941075.615654:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945045504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788941075.615666:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941075.615697:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945045504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (817us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.615703:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788941075.615722:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945045760:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.615747:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.615768:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941075.615774:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945045632:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.615809:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.615835:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045760 00000100:00100000:0.0:1788941075.615838:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045760 00000100:00100000:0.0:1788941075.615863:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945045632 00000100:00100000:0.0:1788941075.615866:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945045632 00000100:00100000:1.0:1788941075.616934:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941075.616952:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839945046400:0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.616986:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941075.617013:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046400 00000100:00100000:1.0:1788941075.617017:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046400 00000100:00100000:2.0:1788941075.617066:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046016 00000100:00100000:2.0:1788941075.617070:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046016 00000100:00100000:2.0:1788941075.617100:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788941075.617108:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945046016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941075.617155:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945046016:12345-0@lo:400:kworker.0 Request processed in 47us (1627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941075.617162:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788941075.617198:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945046016:0@lo:400:kworker.0 00000100:00080000:3.0:1788941075.622052:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941075.622065:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788941075.622068:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788941075.644690:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788941075.644710:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945045760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.644811:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945045760:12345-0@lo:400:kworker.0 Request processed in 108us (29061us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.644819:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788941075.644837:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941075.644847:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945045632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.644884:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945045632:12345-0@lo:400:kworker.0 Request processed in 38us (29074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.644889:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788941075.644927:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945046272:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.644967:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.645024:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945045632:0@lo:400:kworker.0 00000100:00100000:2.0:1788941075.645031:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046272 00000100:00100000:2.0:1788941075.645039:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046272 00000100:00100000:0.0:1788941075.645041:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945045760:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.645069:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941075.645077:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945046144:0@lo:400:kworker.0 00000100:00100000:2.0:1788941075.645084:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788941075.645094:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945046272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.645107:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941075.645156:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3648:x1875839945046272:12345-0@lo:400:kworker.0 Request processed in 64us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.645163:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945045120:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788941075.645165:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788941075.645197:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3648:1875839945046272:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.645220:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046144 00000100:00100000:0.0:1788941075.645223:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046144 00000100:00100000:0.0:1788941075.645290:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788941075.645296:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945046144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.645331:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03475dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945046144:12345-0@lo:400:kworker.0 Request processed in 35us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.645344:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788941075.645372:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945046144:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.645413:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945045504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941075.645860:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788941075.645868:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839945046400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941075.645904:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3646:x1875839945046400:12345-0@lo:400:kworker.0 Request processed in 38us (28917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941075.645910:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1788941075.646767:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788941075.646834:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839945046528:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.646877:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.646922:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3646:1875839945046400:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.646950:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839945046784:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.646982:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.647005:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788941075.647012:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839945046656:0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.647041:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941075.647070:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046528 00000100:00100000:0.0:1788941075.647075:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046528 00000100:00100000:0.0:1788941075.647111:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046784 00000100:00100000:0.0:1788941075.647114:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046784 00000100:00100000:0.0:1788941075.647127:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046656 00000100:00100000:0.0:1788941075.647129:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046656 00000100:00100000:0.0:1788941075.647145:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788941075.647152:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839945046528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.647191:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3646:x1875839945046528:12345-0@lo:400:kworker.0 Request processed in 40us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.647197:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788941075.647208:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788941075.647214:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839945046784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.647253:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3648:x1875839945046784:12345-0@lo:400:kworker.0 Request processed in 40us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.647281:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788941075.647294:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788941075.647301:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839945046656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941075.647328:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3648:x1875839945046656:12345-0@lo:400:kworker.0 Request processed in 28us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941075.647334:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1788941075.647361:0:3646:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020afa300 x1875839945046528/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941075.647372:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3646:1875839945046528:0@lo:400:kworker.0 00000100:00080000:0.0:1788941075.647387:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788941075.648657:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788941075.648693:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3648:1875839945046656:0@lo:400:kworker.0 00010000:00080000:0.0:1788941075.648706:0:3648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d020af9c00 x1875839945046784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941075.648715:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3648:1875839945046784:0@lo:400:kworker.0 00000100:00100000:2.0:1788941076.123563:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788941076.123584:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945046912:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941076.123662:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941076.123707:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945046912 00000100:00100000:2.0:1788941076.123714:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945046912 00000100:00100000:2.0:1788941076.123757:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788941076.123765:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945046912:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941076.123796:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788941076.123840:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945046912:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941076.123847:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788941076.123892:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945046912:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788941076.382085:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941077.147461:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941077.147539:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941077.149742:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945047168:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788941077.149801:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941077.156360:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788941077.156437:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941077.159989:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047040 00000100:00100000:2.0:1788941077.160003:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047040 00000100:00100000:2.0:1788941077.160061:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047296 00000100:00100000:2.0:1788941077.160065:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047296 00000100:00100000:3.0:1788941077.160184:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047168 00000100:00100000:3.0:1788941077.160188:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047168 00000100:00100000:3.0:1788941077.160207:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788941077.160216:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945047040:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788941077.160272:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788941077.160345:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945047040:12345-0@lo:41:osp-pre-0-1.0 Request processed in 125us (12801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941077.160370:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788941077.160418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945047040:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788941077.160446:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788941077.160453:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945047168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941077.160471:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941077.160504:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945047168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 52us (10703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941077.160510:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788941077.160592:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941077.160599:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945047296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788941077.160623:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788941077.160659:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945047296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 62us (4223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941077.160664:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788941077.160705:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945047296:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788941077.162556:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945047168:0@lo:41:osp-pre-1-0.0 00000100:00080000:0.0:1788941077.163844:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788941077.428132:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788941077.706630:0:25755:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd0ad65fd0 20000000:00000080:0.0:1788941077.706653:0:25755:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d005af5400 uarg=0000000000000000 20000000:01000000:0.0:1788941077.706704:0:25755:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788941077.706711:0:25755:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788941077.706721:0:25755:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788941077.707620:0:25756:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:0.0:1788941077.707794:0:25755:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788941077.721039:0:25755:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788941077.721360:0:25755:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721381:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721388:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721394:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08baded40 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721401:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badeeba expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721411:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721442:0:25755:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 12 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721450:0:25755:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721498:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 12 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721513:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 12 pid: 22721 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.721552:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047424:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788941077.721719:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721728:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.721736:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047552:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788941077.721795:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721815:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.721828:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047680:0@lo:104: 00000100:00100000:1.0:1788941077.721872:0:25755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788941077.721916:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721922:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 23 pid: 22719 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.721927:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047808:0@lo:104: 00000100:00100000:1.0:1788941077.721940:0:25755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788941077.721959:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.721964:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.721978:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047936:0@lo:104: 00000100:00100000:1.0:1788941077.721991:0:25755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941077.722023:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047680 00000100:00100000:1.0:1788941077.722031:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047680 00000100:00100000:1.0:1788941077.722068:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047808 00000100:00100000:1.0:1788941077.722071:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047808 00000100:00100000:1.0:1788941077.722092:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945047936 00000100:00100000:1.0:1788941077.722093:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945047936 00000100:00100000:1.0:1788941077.722102:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941077.722107:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+5:25755:x1875839945047680:12345-0@lo:104: 00010000:00010000:1.0:1788941077.722117:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.722159:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788941077.722165:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+5:25755:x1875839945047680:12345-0@lo:104: Request processed in 57us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941077.722180:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788941077.722198:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941077.722203:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+4:25755:x1875839945047808:12345-0@lo:104: 00010000:00010000:1.0:1788941077.722211:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.722241:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788941077.722246:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+4:25755:x1875839945047808:12345-0@lo:104: Request processed in 43us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941077.722252:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788941077.722288:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788941077.722295:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:25755:x1875839945047936:12345-0@lo:104: 00010000:00010000:1.0:1788941077.722302:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.722327:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788941077.722332:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a52a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:25755:x1875839945047936:12345-0@lo:104: Request processed in 38us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941077.722338:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1788941077.722363:0:25755:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 23 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.722371:0:25755:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.722380:0:25755:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945048064:0@lo:104: 00000100:00100000:1.0:1788941077.722400:0:25755:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941077.722422:0:22711:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048064 00000100:00100000:1.0:1788941077.722426:0:22711:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048064 00000100:00100000:1.0:1788941077.722442:0:22711:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941077.722448:0:22711:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:25755:x1875839945048064:12345-0@lo:104: 00010000:00010000:1.0:1788941077.722454:0:22711:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.722480:0:22711:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788941077.722485:0:22711:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:66773969-0b9c-4025-866a-db20e971736d+3:25755:x1875839945048064:12345-0@lo:104: Request processed in 37us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941077.722490:0:22711:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788941077.722527:0:25755:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03ed2a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788941077.722548:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047680:0@lo:104: 00000100:00100000:1.0:1788941077.722552:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047808:0@lo:104: 00000100:00100000:1.0:1788941077.722556:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047936:0@lo:104: 00000100:00100000:1.0:1788941077.722559:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945048064:0@lo:104: 00010000:00010000:3.0:1788941077.722869:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788941077.722877:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.722884:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035936e00 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941077.722888:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.722897:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941077.722904:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941077.722910:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788941077.722940:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.722955:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941077.722984:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.722991:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d035936e00/0x9c34acc08badeeba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badeec1 expref: -99 pid: 25051 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723006:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788941077.723009:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723015:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d035937800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941077.723018:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723025:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941077.723031:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941077.723036:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788941077.723048:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723053:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941077.723058:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723064:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d035937800/0x9c34acc08baded40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded47 expref: -99 pid: 24230 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723077:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788941077.723080:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723085:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1800 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941077.723087:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723093:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941077.723099:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941077.723103:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788941077.723115:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723120:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941077.723133:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723139:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d02e8e1800/0x9c34acc08baded01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08baded08 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723147:0:22716:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788941077.723150:0:22716:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723165:0:22716:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d000 already unused, calling callback (ffffffffc12d7c20) 10000000:00010000:3.0:1788941077.723168:0:22716:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723174:0:22716:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788941077.723179:0:22716:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941077.723183:0:22716:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788941077.723195:0:22716:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723200:0:22716:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788941077.723206:0:22716:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723213:0:22716:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.125@tcp lock: ffff91d03584d000/0x9c34acc08badecf3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x9c34acc08badecfa expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941077.723225:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941077.723227:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788941077.723229:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941077.723240:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945048320:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941077.723292:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941077.723410:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788941077.723420:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945048192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788941077.723449:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941077.725353:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945048448:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941077.725417:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941077.725473:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941077.725480:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945048576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941077.725501:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941077.725526:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048320 00000100:00100000:2.0:1788941077.725534:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048320 00010000:00010000:2.0:1788941077.725570:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 24 pid: 22719 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941077.725591:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048192 00000100:00100000:2.0:1788941077.725594:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048192 00010000:00010000:2.0:1788941077.725619:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 25 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941077.725631:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048448 00000100:00100000:2.0:1788941077.725634:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048448 00010000:00010000:2.0:1788941077.725643:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 26 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941077.725654:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048576 00000100:00100000:2.0:1788941077.725656:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048576 00010000:00010000:2.0:1788941077.725665:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 27 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941077.725678:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941077.725686:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+27:3646:x1875839945048320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941077.725718:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941077.725723:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 27 pid: 22719 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725735:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 27 pid: 22719 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725751:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584ca00/0x9c34acc08baded47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08baded40 expref: 27 pid: 22719 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725767:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941077.725810:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+26:3646:x1875839945048320:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941077.725817:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788941077.725917:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788941077.725924:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+25:3646:x1875839945048192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941077.725932:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941077.725936:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 25 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725944:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 25 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725967:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584c800/0x9c34acc08badeec1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badeeba expref: 25 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.725975:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941077.725997:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+24:3646:x1875839945048192:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (2548us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941077.726012:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788941077.726049:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941077.726070:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+23:3647:x1875839945048448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941077.726080:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941077.726084:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726124:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726134:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d03584d800/0x9c34acc08baded08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08baded01 expref: 23 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726142:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941077.726169:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+22:3647:x1875839945048448:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941077.726175:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788941077.726187:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941077.726193:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+21:3647:x1875839945048576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788941077.726200:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941077.726204:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 21 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726212:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 21 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726221:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d02e8e0e00/0x9c34acc08badecfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x9c34acc08badecf3 expref: 21 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.726240:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941077.726302:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:66773969-0b9c-4025-866a-db20e971736d+20:3647:x1875839945048576:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941077.726309:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788941077.726388:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945048192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941077.726400:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:66773969-0b9c-4025-866a-db20e971736d:3646:1875839945048320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941077.726447:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945048576:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788941077.726457:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945048448:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788941077.727646:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941077.733853:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047424:192.168.202.25@tcp:104: 00000100:00100000:1.0:1788941077.733871:0:25755:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25755:1875839945047552:192.168.202.25@tcp:104: 00010000:00010000:1.0:1788941077.733920:0:25755:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941077.735781:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941077.735850:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844608 00000100:00100000:0.0:1788941077.735859:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844608 00010000:00010000:0.0:1788941077.735899:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941077.735945:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:0.0:1788941077.735954:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:2405:x1875839921844608:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941077.735980:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941077.735987:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941077.736001:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941077.736019:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d035937000/0x9c34acc08badf06c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7880 expref: 13 pid: 22721 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941077.736033:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941077.736086:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07a61c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:2405:x1875839921844608:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 132us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941077.736093:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:3.0:1788941077.742237:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941077.742349:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844736 00000100:00100000:1.0:1788941077.742360:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844736 00010000:00010000:1.0:1788941077.742403:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941077.742442:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:1.0:1788941077.742453:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:2404:x1875839921844736:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941077.742485:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941077.742491:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742503:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742522:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91cf060fae00/0x9c34acc08badf02d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7810 expref: 12 pid: 22722 timeout: 933 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742540:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742549:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742566:0:22714:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742573:0:22714:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742579:0:22714:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742586:0:22714:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742592:0:22714:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:1.0:1788941077.742606:0:22714:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742626:0:22714:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742645:0:22714:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941077.742659:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941077.742727:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:2404:x1875839921844736:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 274us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941077.742735:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00010000:00010000:2.0:1788941077.742820:0:25755:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.742829:0:25755:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941077.742835:0:25755:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d001219a00/0x9c34acc08badf09d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25755 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.428480:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788941078.939357:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788941078.939365:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91cf06069800 from 13 10000000:01000000:1.0:1788941078.939370:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788941078.939419:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.939431:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.939443:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941078.939468:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.939534:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941078.939574:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0240 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.939704:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048704 00000100:00100000:0.0:1788941078.939713:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048704 00000100:00100000:0.0:1788941078.939839:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788941078.939850:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+20:22724:x1875839945048704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941078.939881:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941078.939894:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e0400/0x9c34acc08badf0ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badf0a4 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.939917:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e0400/0x9c34acc08badf0ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badf0a4 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.939928:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e0400/0x9c34acc08badf0ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badf0a4 expref: 21 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.939937:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0400, rc 0) 00000100:00100000:0.0:1788941078.939994:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945048704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.940000:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788941078.940099:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a53480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941078.940114:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0ab expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.940123:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badf0ab expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941078.940205:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.940231:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941078.940296:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941078.940450:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048832 00000100:00100000:1.0:1788941078.940455:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048832 00000100:00100000:1.0:1788941078.940488:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788941078.940495:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945048832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.940617:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945048832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941078.940624:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788941078.941006:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.941035:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.941074:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941078.941100:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941078.942326:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945048960 00000100:00100000:1.0:1788941078.942336:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945048960 00000100:00100000:1.0:1788941078.942385:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788941078.942392:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945048960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.942529:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00d3fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945048960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941078.942537:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788941078.942720:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945048960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788941078.943744:0:25768:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788941078.950543:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788941078.950580:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941078.950600:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0ab expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.950614:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001218600/0x9c34acc08badf0a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0ab expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788941078.950625:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788941078.950628:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03ec16800 from 13 10000000:01000000:2.0:1788941078.950631:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788941078.950671:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.950679:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.950690:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941078.950727:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.950866:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941078.950916:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.951372:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049088 00000100:00100000:0.0:1788941078.951381:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049088 00000100:00100000:0.0:1788941078.951432:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788941078.951442:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+21:22724:x1875839945049088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941078.951455:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941078.951469:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badf0b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badf0b2 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.951492:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badf0b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badf0b2 expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.951503:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1200/0x9c34acc08badf0b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badf0b2 expref: 22 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.951512:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1200, rc 0) 00000100:00100000:0.0:1788941078.951571:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.951578:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788941078.951706:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941078.951722:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0b9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.951731:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badf0b9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941078.951868:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.951896:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941078.951925:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beba80 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.952060:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049216 00000100:00100000:0.0:1788941078.952065:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049216 00000100:00100000:0.0:1788941078.952095:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788941078.952102:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788941078.952220:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.952228:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788941078.952349:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.952375:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.952412:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941078.952443:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788941078.952637:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049344 00000100:00100000:1.0:1788941078.952642:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049344 00000100:00100000:1.0:1788941078.952672:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788941078.952679:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.952833:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941078.952840:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788941078.953091:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049344:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788941078.954203:0:25769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788941078.954955:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788941078.954978:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788941078.954988:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0b9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.955000:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91cf060fbe00/0x9c34acc08badf0b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0b9 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788941078.955011:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788941078.955025:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d03593f000 from 13 10000000:01000000:1.0:1788941078.955028:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788941078.955059:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.955074:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941078.955085:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941078.955106:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.955170:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941078.955201:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf06ff0c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.955715:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049472 00000100:00100000:0.0:1788941078.955723:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049472 00000100:00100000:0.0:1788941078.955871:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788941078.955882:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+22:22724:x1875839945049472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941078.955895:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941078.955914:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e0a00/0x9c34acc08badf0c7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badf0c0 expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.955937:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e0a00/0x9c34acc08badf0c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badf0c0 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.955948:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e0a00/0x9c34acc08badf0c7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badf0c0 expref: 23 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.955957:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0a00, rc 0) 00000100:00100000:0.0:1788941078.956011:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.956018:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788941078.956097:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d035a50380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788941078.956112:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0c7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.956122:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badf0c7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941078.956203:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.956233:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941078.956644:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beb780 going to sleep for 11 seconds 00000100:00100000:1.0:1788941078.956708:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049600 00000100:00100000:1.0:1788941078.956714:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049600 00000100:00100000:1.0:1788941078.956743:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788941078.956749:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.956936:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941078.956944:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788941078.957007:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.957037:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.957075:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941078.957095:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.957121:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049728 00000100:00100000:0.0:1788941078.957125:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049728 00000100:00100000:0.0:1788941078.957147:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788941078.957163:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.957663:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941078.957731:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.957739:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000040:00080000:0.0:1788941078.959224:0:25770:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788941078.959666:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788941078.959692:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788941078.959702:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0c7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.959715:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d001218e00/0x9c34acc08badf0c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0c7 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788941078.959727:0:22724:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788941078.959729:0:22724:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff91d0065f9800 from 13 10000000:01000000:3.0:1788941078.959732:0:22724:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788941078.959835:0:22724:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.959845:0:22724:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941078.959855:0:22724:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941078.959890:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788941078.959947:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941078.959983:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beb780 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.962897:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049856 00000100:00100000:0.0:1788941078.962910:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049856 00000100:00100000:0.0:1788941078.963007:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788941078.963018:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+23:22724:x1875839945049856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941078.963036:0:22719:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941078.963054:0:22719:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1a00/0x9c34acc08badf0d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x9c34acc08badf0ce expref: -99 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.963081:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1a00/0x9c34acc08badf0d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x9c34acc08badf0ce expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.963093:0:22719:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1a00/0x9c34acc08badf0d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x9c34acc08badf0ce expref: 24 pid: 22719 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941078.963103:0:22719:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1a00, rc 0) 00000100:00100000:0.0:1788941078.963182:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945049856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (3234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.963189:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788941078.964227:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dcd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788941078.964276:0:22724:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0d5 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.964288:0:22724:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x9c34acc08badf0d5 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941078.964365:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.964405:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941078.964949:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06600 going to sleep for 11 seconds 00000100:00100000:1.0:1788941078.965873:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945049984 00000100:00100000:1.0:1788941078.965884:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945049984 00000100:00100000:1.0:1788941078.965932:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788941078.965941:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945049984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941078.966080:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945049984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 140us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941078.966088:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788941078.966312:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945049984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.966414:0:22724:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945050112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788941078.966456:0:22724:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941078.966481:0:22724:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d02eb06600 going to sleep for 11 seconds 00000100:00100000:0.0:1788941078.966625:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945050112 00000100:00100000:0.0:1788941078.966631:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945050112 00000100:00100000:0.0:1788941078.966657:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788941078.966671:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945050112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941078.966892:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:22724:x1875839945050112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 220us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941078.966899:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788941078.967083:0:22724:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:66773969-0b9c-4025-866a-db20e971736d:22724:1875839945050112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788941078.973572:0:25771:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788941078.973834:0:22724:0:(obd_config.c:2244:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788941078.973857:0:22724:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.125@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788941078.973869:0:22724:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0d5 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941078.973881:0:22724:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.125@tcp lock: ffff91d004602000/0x9c34acc08badf0ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x9c34acc08badf0d5 expref: -99 pid: 22724 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941079.334326:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334403:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334434:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334466:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334483:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334501:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334522:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334538:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334558:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.334608:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845120 00000100:00100000:3.0:1788941079.334618:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845120 00000100:00100000:3.0:1788941079.334668:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845632 00000100:00100000:3.0:1788941079.334670:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845632 00000100:00100000:3.0:1788941079.334683:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844992 00000100:00100000:3.0:1788941079.334685:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844992 00000100:00100000:3.0:1788941079.334696:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845504 00000100:00100000:3.0:1788941079.334698:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845504 00000100:00100000:3.0:1788941079.334711:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788941079.334720:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845120:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788941079.334869:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845120:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941079.334878:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788941079.334894:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788941079.334900:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845632:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788941079.334942:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845632:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 42us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941079.334948:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788941079.334972:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788941079.334978:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921844992:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788941079.335001:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921844992:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 23us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941079.335007:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:3.0:1788941079.335016:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788941079.335022:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2405:x1875839921845504:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:3.0:1788941079.335040:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2405:x1875839921845504:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 18us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941079.335046:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:0.0:1788941079.335440:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845376 00000100:00100000:0.0:1788941079.335446:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845376 00000100:00100000:0.0:1788941079.335470:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845888 00000100:00100000:0.0:1788941079.335472:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845888 00000100:00100000:0.0:1788941079.335485:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845248 00000100:00100000:0.0:1788941079.335487:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845248 00000100:00100000:0.0:1788941079.335499:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921845760 00000100:00100000:0.0:1788941079.335502:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921845760 00000100:00100000:0.0:1788941079.335515:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788941079.335522:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845376:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941079.335562:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dce300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845376:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 41us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.335569:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788941079.335593:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788941079.335600:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845888:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941079.335622:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845888:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.335627:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:0.0:1788941079.335637:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788941079.335642:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845248:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941079.335661:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921845248:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.335674:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:0.0:1788941079.335684:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1788941079.335690:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845760:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941079.335708:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921845760:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 19us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.335715:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00080000:0.0:1788941079.335743:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788941079.335747:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788941079.335749:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788941079.335768:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788941079.336417:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921844864 00000100:00100000:1.0:1788941079.336426:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921844864 00000100:00100000:1.0:1788941079.336507:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:1.0:1788941079.336515:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:2405:x1875839921844864:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941079.336561:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:2405:x1875839921844864:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 46us (2246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941079.336567:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 162 00000100:00100000:3.0:1788941079.401065:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.401470:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846016 00000100:00100000:0.0:1788941079.401481:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846016 00000100:00100000:0.0:1788941079.401704:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:0.0:1788941079.401717:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+11:18140:x1875839921846016:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788941079.401735:0:22721:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941079.401859:0:22721:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d02e8e1800/0x9c34acc08badf0dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78b8 expref: -99 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.401892:0:22721:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d02e8e1800/0x9c34acc08badf0dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b8 expref: 12 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.401904:0:22721:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d02e8e1800/0x9c34acc08badf0dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b8 expref: 12 pid: 22721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.401915:0:22721:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1800, rc 0) 00000100:00100000:0.0:1788941079.402016:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846016:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 302us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.402046:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 163 00000100:00100000:3.0:1788941079.413712:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941079.413909:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846144 00000100:00100000:1.0:1788941079.413921:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846144 00000100:00100000:1.0:1788941079.414089:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:1.0:1788941079.414100:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846144:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941079.414313:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846144:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 214us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941079.414322:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 164 00000100:00100000:3.0:1788941079.418394:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.418466:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846272 00000100:00100000:0.0:1788941079.418478:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846272 00000100:00100000:0.0:1788941079.418536:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:0.0:1788941079.418546:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846272:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941079.418703:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e74850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846272:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 157us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.418711:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 165 00000100:00100000:3.0:1788941079.435326:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941079.435619:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846400 00000100:00100000:1.0:1788941079.435631:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846400 00000100:00100000:1.0:1788941079.435702:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:1.0:1788941079.435712:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+12:18140:x1875839921846400:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788941079.435730:0:22722:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941079.435749:0:22722:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d001219e00/0x9c34acc08badf0e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78bf expref: -99 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941079.435778:0:22722:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d001219e00/0x9c34acc08badf0e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78bf expref: 13 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941079.435789:0:22722:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d001219e00/0x9c34acc08badf0e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78bf expref: 13 pid: 22722 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941079.435815:0:22722:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219e00, rc 0) 00000100:00100000:1.0:1788941079.435911:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07e75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18140:x1875839921846400:12345-192.168.202.25@tcp:101:ll_cfg_requeue.0 Request processed in 200us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941079.435919:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 166 00000100:00100000:3.0:1788941079.445541:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941079.445623:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846528 00000100:00100000:1.0:1788941079.445634:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846528 00000100:00100000:1.0:1788941079.445698:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:1.0:1788941079.445708:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18140:x1875839921846528:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788941079.445894:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18140:x1875839921846528:12345-192.168.202.25@tcp:501:ll_cfg_requeue.0 Request processed in 186us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941079.445902:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 167 00000100:00100000:3.0:1788941079.447433:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.447536:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846656 00000100:00100000:0.0:1788941079.447544:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846656 00000100:00100000:0.0:1788941079.447607:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 168 00000100:00100000:0.0:1788941079.447617:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18140:x1875839921846656:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788941079.447757:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:18140:x1875839921846656:12345-192.168.202.25@tcp:503:ll_cfg_requeue.0 Request processed in 141us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.447764:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 168 00010000:00010000:0.0:1788941079.451419:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941079.831475:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941079.832250:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846784 00000100:00100000:2.0:1788941079.832289:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846784 00000100:00100000:2.0:1788941079.832371:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:2.0:1788941079.832381:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:18763:x1875839921846784:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788941079.832403:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941079.832426:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa600/0x9c34acc08badf0ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78c6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832729:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832745:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832760:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832774:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832781:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.832788:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833008:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fba00/0x9c34acc08badf0ff lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833017:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fba00/0x9c34acc08badf0ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833039:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fba00/0x9c34acc08badf0ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941079.833074:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788941079.833078:0:22729:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941079.833114:0:22729:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fba00/0x9c34acc08badf0ff lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833124:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833130:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833136:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833142:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fa400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788941079.833147:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833155:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833166:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:2.0:1788941079.833169:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941079.833174:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833180:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf0f1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833205:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833211:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833216:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833221:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060faa00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788941079.833224:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833229:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833236:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91d005089300) 00010000:00010000:2.0:1788941079.833238:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941079.833240:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833246:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf0f8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833439:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa600/0x9c34acc08badf0ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78c6 expref: 8 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833598:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fba00/0x9c34acc08badf0ff lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78c6 expref: 7 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941079.833617:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d005089500) 00010000:00010000:2.0:1788941079.833619:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788941079.833622:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fba00, rc 0) 00000100:00100000:2.0:1788941079.833709:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18763:x1875839921846784:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1328us (2260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941079.833718:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788941079.841477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941079.841603:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921846912 00000100:00100000:2.0:1788941079.841615:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921846912 00000100:00100000:2.0:1788941079.841675:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1788941079.841686:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18763:x1875839921846912:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788941079.841789:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18763:x1875839921846912:12345-192.168.202.25@tcp:900:lhsmtool_posix.0 Request processed in 103us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941079.841796:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:3.0:1788941079.849400:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.849509:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847168 00000100:00100000:0.0:1788941079.849520:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847168 00000100:00100000:0.0:1788941079.849600:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:0.0:1788941079.849612:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18763:x1875839921847168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788941079.849638:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941079.849660:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf106 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78cd expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849746:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849776:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849787:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849799:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849803:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849817:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849951:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08badf11b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849959:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08badf11b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.849966:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08badf11b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941079.849976:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788941079.850127:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850133:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850140:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850151:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941079.850155:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850162:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850174:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d005089500) 00010000:00010000:0.0:1788941079.850177:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.850182:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850189:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf10d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850202:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850206:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850209:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850212:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941079.850214:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850217:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850229:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d03ed37a00) 00010000:00010000:0.0:1788941079.850231:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.850233:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.850237:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf114 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.852373:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf106 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78cd expref: 10 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.852394:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0600/0x9c34acc08badf11b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78cd expref: 9 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.852400:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788941079.852402:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.852404:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0600, rc 0) 00000100:00100000:0.0:1788941079.852472:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18763:x1875839921847168:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2861us (3081us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788941079.852480:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 24 00000100:00100000:1.0:1788941079.863406:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.864786:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847296 00000100:00100000:0.0:1788941079.864798:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847296 00000100:00100000:0.0:1788941079.864862:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1788941079.864871:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18763:x1875839921847296:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788941079.864997:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18763:x1875839921847296:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 124us (1598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941079.865005:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:3.0:1788941079.876627:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941079.876817:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847424 00000100:00100000:2.0:1788941079.876828:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847424 00000100:00100000:2.0:1788941079.876951:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1788941079.876963:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18763:x1875839921847424:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 00000004:00080000:3.0:1788941079.880890:0:22727:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3880us 00000100:00100000:1.0:1788941079.893961:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18763:x1875839921847424:12345-192.168.202.25@tcp:59:lhsmtool_posix.0 Request processed in 16990us (17333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941079.893976:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000040:00080000:3.0:1788941079.900070:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788941079.964128:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788941079.978549:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941079.983725:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847552 00000100:00100000:0.0:1788941079.983748:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847552 00000100:00100000:0.0:1788941079.983867:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1788941079.983882:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18769:x1875839921847552:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788941079.983911:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941079.983952:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf129 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78d4 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984023:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984038:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984050:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984090:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984097:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984104:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984441:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984450:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984481:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984488:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941079.984493:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984502:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984515:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:0.0:1788941079.984518:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.984524:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984531:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf130 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984546:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984552:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984557:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984562:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941079.984565:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984593:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984602:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d03ed37a00) 00010000:00010000:0.0:1788941079.984604:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.984608:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984614:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf137 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984651:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf129 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78d4 expref: 10 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984662:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:0.0:1788941079.984664:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941079.984668:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf129 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78d4 expref: 10 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941079.984678:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0e00, rc 0) 00000100:00100000:0.0:1788941079.984764:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18769:x1875839921847552:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 884us (6231us total) trans 0 rc 301/301 00000100:00100000:0.0:1788941079.984772:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:2.0:1788941079.996399:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941079.996643:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847680 00000100:00100000:3.0:1788941079.996654:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847680 00000100:00100000:3.0:1788941079.996713:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788941079.996724:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18769:x1875839921847680:12345-192.168.202.25@tcp:700:lfs.0 00000100:00100000:3.0:1788941079.996831:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18769:x1875839921847680:12345-192.168.202.25@tcp:700:lfs.0 Request processed in 109us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941079.996839:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788941080.001591:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.001770:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921847936 00000100:00100000:0.0:1788941080.001782:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921847936 00000100:00100000:0.0:1788941080.001941:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1788941080.001953:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:18769:x1875839921847936:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:0.0:1788941080.002032:0:24594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941080.002061:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf057 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7841 expref: 9 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.002080:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:0.0:1788941080.002086:0:24594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941080.002158:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.002172:0:24594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 5 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.002180:0:24594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.002218:0:24594:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 5 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.002233:0:24594:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 5 pid: 22727 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941080.002319:0:24594:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24594:1875839945050240:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788941080.002418:0:24594:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d03598a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788941080.009418:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.009646:0:24594:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:24594:1875839945050240:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788941080.009674:0:24594:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941080.010251:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848064 00000100:00100000:3.0:1788941080.010293:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848064 00010000:00010000:3.0:1788941080.010334:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 6 pid: 22727 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941080.010383:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:3.0:1788941080.010396:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2405:x1875839921848064:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941080.010412:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941080.010419:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 6 pid: 22727 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010434:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 6 pid: 22727 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010469:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf096 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78b1 expref: 6 pid: 22727 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010502:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:3.0:1788941080.010507:0:22713:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010517:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010525:0:22713:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.010553:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941080.010620:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2405:x1875839921848064:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 227us (1210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.010628:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00010000:00010000:2.0:1788941080.011654:0:24594:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.011682:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.011710:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.011720:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.011729:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016871:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016897:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016909:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788941080.016937:0:24594:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070c7ac2e reply state 00000000a99c911c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016949:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016957:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:2.0:1788941080.016959:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788941080.016964:0:24594:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788941080.016970:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788941080.016990:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.016997:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017004:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017009:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788941080.017013:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017020:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017030:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfd000) 00010000:00010000:2.0:1788941080.017032:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941080.017036:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017042:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf13e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788941080.017064:0:24594:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070c7ac2e reply state 00000000a99c911c transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017072:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.017078:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d005089300) 00010000:00010000:2.0:1788941080.017080:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788941080.017087:0:24594:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788941080.017851:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+10:18769:x1875839921847936:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 15894us (16409us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788941080.017862:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1788941080.185197:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941080.185418:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848192 00000100:00100000:1.0:1788941080.185428:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848192 00000100:00100000:1.0:1788941080.185503:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:1.0:1788941080.185514:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+10:18777:x1875839921848192:12345-192.168.202.25@tcp:101:lctl.0 00010000:00010000:1.0:1788941080.185554:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941080.185589:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08badf153 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78db expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185666:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf15a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185693:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf15a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185704:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf15a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941080.185751:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788941080.185755:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941080.185797:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf15a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185823:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08badf153 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78db expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185846:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219400/0x9c34acc08badf15a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78db expref: 11 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.185855:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941080.185858:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941080.185861:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219400, rc 0) 00000100:00100000:1.0:1788941080.185939:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+11:18777:x1875839921848192:12345-192.168.202.25@tcp:101:lctl.0 Request processed in 426us (752us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941080.185947:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:3.0:1788941080.218539:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941080.218773:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848320 00000100:00100000:1.0:1788941080.218783:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848320 00000100:00100000:1.0:1788941080.218895:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:1.0:1788941080.218908:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:18778:x1875839921848320:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788941080.221088:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941080.221149:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08badf161 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78e2 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221219:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08badf168 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221230:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08badf168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221239:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08badf168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941080.221301:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788941080.221303:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941080.221322:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08badf168 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221343:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001218a00/0x9c34acc08badf161 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78e2 expref: 7 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221359:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219200/0x9c34acc08badf168 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78e2 expref: 6 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.221365:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941080.221368:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941080.221371:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d001219200, rc 0) 00000100:00100000:1.0:1788941080.221566:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18778:x1875839921848320:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 2659us (3119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941080.221588:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:3.0:1788941080.238143:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941080.238540:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848448 00000100:00100000:1.0:1788941080.238563:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848448 00000100:00100000:1.0:1788941080.238637:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:1.0:1788941080.238648:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:18778:x1875839921848448:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788941080.238670:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941080.238700:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08badf16f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78e9 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238785:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238800:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238826:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238839:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238846:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238852:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238925:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238942:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.238949:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941080.238992:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788941080.238995:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941080.239015:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239026:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239033:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239040:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239045:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d001219a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941080.239050:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239057:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239069:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941080.239071:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941080.239076:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239082:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219a00/0x9c34acc08badf176 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239094:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239110:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239116:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239121:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941080.239124:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239141:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239149:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d005089300) 00010000:00010000:1.0:1788941080.239152:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941080.239155:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239161:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf17d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239188:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d001219800/0x9c34acc08badf16f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78e9 expref: 8 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239202:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78e9 expref: 7 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.239209:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:1.0:1788941080.239212:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941080.239219:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6000, rc 0) 00000100:00100000:1.0:1788941080.239308:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+7:18778:x1875839921848448:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 661us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941080.239315:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:0.0:1788941080.244541:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941080.244728:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848576 00000100:00100000:3.0:1788941080.244738:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848576 00000100:00100000:3.0:1788941080.244783:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1788941080.244790:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:18778:x1875839921848576:12345-192.168.202.25@tcp:900:lfs.0 00000100:00100000:3.0:1788941080.244867:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:18778:x1875839921848576:12345-192.168.202.25@tcp:900:lfs.0 Request processed in 78us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.244873:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:3.0:1788941080.249970:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.250796:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921848832 00000100:00100000:2.0:1788941080.250808:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921848832 00000100:00100000:2.0:1788941080.250935:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:2.0:1788941080.250947:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+7:18778:x1875839921848832:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788941080.250967:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941080.250989:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf18b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78f0 expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941080.251094:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788941080.251386:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf18b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78f0 expref: 9 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.251401:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:2.0:1788941080.251404:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788941080.251409:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf18b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78f0 expref: 9 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.251421:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fa000, rc 0) 00000100:00100000:2.0:1788941080.251490:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+8:18778:x1875839921848832:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 545us (1530us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788941080.251497:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:1.0:1788941080.256008:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.256160:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921849088 00000100:00100000:0.0:1788941080.256172:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921849088 00000100:00100000:0.0:1788941080.256279:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:0.0:1788941080.256290:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+8:18778:x1875839921849088:12345-192.168.202.25@tcp:36:lfs.0 00010000:00010000:0.0:1788941080.256358:0:22728:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941080.256388:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6000/0x9c34acc08badf184 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78e9 expref: 8 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.256409:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941080.256415:0:22728:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941080.256440:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.256454:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.256466:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788941080.256942:0:22728:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001831b462 reply state 00000000b5bf61a9 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.256957:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.256963:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941080.256965:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788941080.256968:0:22728:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788941080.256976:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788941080.257068:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+9:18778:x1875839921849088:12345-192.168.202.25@tcp:36:lfs.0 Request processed in 778us (1070us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788941080.257075:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:3.0:1788941080.260620:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.260693:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921849344 00000100:00100000:2.0:1788941080.260705:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921849344 00000100:00100000:2.0:1788941080.260755:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:2.0:1788941080.260779:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+9:18778:x1875839921849344:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788941080.262001:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+10:18778:x1875839921849344:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 1216us (1383us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1788941080.262012:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:3.0:1788941080.265703:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941080.266092:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921849600 00000100:00100000:1.0:1788941080.266103:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921849600 00000100:00100000:1.0:1788941080.266172:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1788941080.266184:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+10:18778:x1875839921849600:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788941080.266211:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941080.266232:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf1a0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78f7 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266349:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266366:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266379:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266391:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266398:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266405:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941080.266528:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788941080.266620:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266628:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266636:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266642:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941080.266647:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266665:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266679:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941080.266683:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941080.266688:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266694:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf1a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266707:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266713:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266730:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266735:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941080.266738:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266745:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266753:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d005089300) 00010000:00010000:1.0:1788941080.266755:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941080.266759:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266764:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf1ae lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266799:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf1a0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78f7 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266809:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941080.266811:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788941080.266814:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf1a0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78f7 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941080.266822:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7400, rc 0) 00000100:00100000:1.0:1788941080.266878:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+11:18778:x1875839921849600:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 696us (1185us total) trans 12884901894 rc 301/301 00000100:00100000:1.0:1788941080.266894:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 34 00000100:00100000:1.0:1788941080.274864:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.275081:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921849728 00000100:00100000:0.0:1788941080.275093:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921849728 00000100:00100000:0.0:1788941080.275306:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:0.0:1788941080.275318:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+11:18778:x1875839921849728:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788941080.275346:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941080.275369:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf1bc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc78fe expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275475:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275490:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275503:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941080.275529:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788941080.275532:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941080.275553:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275590:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf1bc lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 13 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275608:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.275617:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941080.275620:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788941080.275636:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1c00, rc 0) 00000100:00100000:0.0:1788941080.275911:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a50380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+12:18778:x1875839921849728:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 595us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.275929:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 35 00000100:00100000:2.0:1788941080.281528:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.281647:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921849856 00000100:00100000:0.0:1788941080.281668:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921849856 00000100:00100000:0.0:1788941080.281728:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:0.0:1788941080.281739:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+12:18778:x1875839921849856:12345-192.168.202.25@tcp:37:lfs.0 00000100:00100000:0.0:1788941080.286691:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+12:18778:x1875839921849856:12345-192.168.202.25@tcp:37:lfs.0 Request processed in 4940us (5158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.286706:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:3.0:1788941080.291117:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.291250:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850112 00000100:00100000:2.0:1788941080.291310:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850112 00000100:00100000:2.0:1788941080.291376:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:2.0:1788941080.291386:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d042076450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+12:18778:x1875839921850112:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788941080.291693:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d042076450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+13:18778:x1875839921850112:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 307us (593us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788941080.291702:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 4 00000100:00100000:1.0:1788941080.383477:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941080.384097:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850240 00000100:00100000:3.0:1788941080.384113:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850240 00000100:00100000:3.0:1788941080.384206:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1788941080.384218:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+11:18785:x1875839921850240:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788941080.384249:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941080.384332:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badf1ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7905 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384411:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384429:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384443:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384453:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384460:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384466:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384562:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badf1df lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384589:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badf1df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941080.384616:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badf1df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941080.384973:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788941080.384978:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941080.387892:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badf1df lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387925:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387935:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387943:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387949:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941080.387954:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387964:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.387983:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:0.0:1788941080.388007:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941080.388015:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388022:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603400/0x9c34acc08badf1d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388044:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388051:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388056:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388061:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941080.388064:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388070:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388079:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d005089300) 00010000:00010000:0.0:1788941080.388082:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941080.388086:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388091:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603800/0x9c34acc08badf1d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388353:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602800/0x9c34acc08badf1ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7905 expref: 13 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388384:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603600/0x9c34acc08badf1df lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7905 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.388392:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941080.388394:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788941080.388397:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603600, rc 0) 00000100:00100000:0.0:1788941080.388489:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d035a53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+12:18785:x1875839921850240:12345-192.168.202.25@tcp:101:bash.0 Request processed in 4271us (5024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.388499:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 36 00000100:00100000:3.0:1788941080.392148:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.392316:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850368 00000100:00100000:2.0:1788941080.392330:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850368 00000100:00100000:2.0:1788941080.392392:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:2.0:1788941080.392403:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18785:x1875839921850368:12345-192.168.202.25@tcp:900:bash.0 00000100:00100000:2.0:1788941080.392486:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:18785:x1875839921850368:12345-192.168.202.25@tcp:900:bash.0 Request processed in 85us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.392494:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1788941080.396461:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.396568:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850624 00000100:00100000:2.0:1788941080.396590:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850624 00000100:00100000:2.0:1788941080.396664:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:2.0:1788941080.396676:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+12:18785:x1875839921850624:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788941080.396697:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941080.396718:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf1e6 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc790c expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.396845:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.396861:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.396872:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.396911:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 12 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.396926:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 12 pid: 22728 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941080.396940:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875839945050368:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788941080.397029:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00c89c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788941080.401670:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.401804:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850752 00000100:00100000:0.0:1788941080.401814:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850752 00010000:00010000:0.0:1788941080.401859:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 13 pid: 22728 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941080.401907:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 16 00000100:00100000:0.0:1788941080.401918:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+13:2405:x1875839921850752:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941080.401933:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941080.401940:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 13 pid: 22728 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.401954:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 13 pid: 22728 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.401986:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941080.401993:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.402022:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.402031:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.402056:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941080.402125:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a21cd3f3-8c72-4460-9f1e-22e6666edfab+13:2405:x1875839921850752:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 208us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.402143:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 16 00010000:00010000:2.0:1788941080.403386:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf1c3 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc78fe expref: 12 pid: 22728 timeout: 935 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941080.403408:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875839945050368:192.168.202.25@tcp:104: 00010000:00010000:2.0:1788941080.403433:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.403442:0:22729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.403465:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.403512:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.403524:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.403534:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405385:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405404:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405415:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941080.405428:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788941080.405456:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405464:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405470:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405476:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fb000 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788941080.405487:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405495:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405506:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:2.0:1788941080.405509:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788941080.405514:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405520:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf1ed lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788941080.405535:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ed43ae8 reply state 00000000eb09a8f6 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405546:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405552:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff91d005089c00) 00010000:00010000:2.0:1788941080.405555:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788941080.405557:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788941080.405607:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf1e6 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 15 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405622:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 14 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.405630:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941080.405632:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788941080.405641:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fbc00, rc 0) 00000100:00100000:2.0:1788941080.405932:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:18785:x1875839921850624:12345-192.168.202.25@tcp:101:bash.0 Request processed in 9257us (9479us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1788941080.405941:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 37 00000100:00100000:1.0:1788941080.426425:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.426587:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921850880 00000100:00100000:2.0:1788941080.426601:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921850880 00000100:00100000:2.0:1788941080.426684:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:2.0:1788941080.426696:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:18785:x1875839921850880:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788941080.426729:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941080.426751:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf209 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7913 expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426822:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426837:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426849:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941080.426897:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788941080.426901:0:24594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788941080.426921:0:24594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426932:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426956:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf209 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7913 expref: 17 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.426992:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7913 expref: 16 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.427001:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941080.427005:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788941080.427008:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fb000, rc 0) 00000100:00100000:2.0:1788941080.427074:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+16:18785:x1875839921850880:12345-192.168.202.25@tcp:101:bash.0 Request processed in 381us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.427081:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 38 00000100:00100000:1.0:1788941080.433146:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.433289:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921851136 00000100:00100000:2.0:1788941080.433310:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921851136 00000100:00100000:2.0:1788941080.433374:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 5 00000100:00100000:2.0:1788941080.433385:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+16:18785:x1875839921851136:12345-192.168.202.25@tcp:35:bash.0 00000100:00100000:2.0:1788941080.433834:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+17:18785:x1875839921851136:12345-192.168.202.25@tcp:35:bash.0 Request processed in 449us (710us total) trans 12884901897 rc 0/0 00000100:00100000:2.0:1788941080.433843:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 5 00010000:00010000:3.0:1788941080.478113:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941080.566559:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.566804:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921851392 00000100:00100000:0.0:1788941080.566815:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921851392 00000100:00100000:0.0:1788941080.566879:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:0.0:1788941080.566889:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+17:18795:x1875839921851392:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:0.0:1788941080.566913:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941080.566932:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf217 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc791a expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941080.567037:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788941080.567147:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf217 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc791a expref: 19 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.567160:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:0.0:1788941080.567163:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788941080.567169:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf217 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc791a expref: 19 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.567183:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0200, rc 0) 00000100:00100000:0.0:1788941080.567297:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+18:18795:x1875839921851392:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 409us (747us total) trans 12884901898 rc 301/301 00000100:00100000:0.0:1788941080.567305:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 39 00000100:00100000:1.0:1788941080.570441:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.570539:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921851648 00000100:00100000:2.0:1788941080.570549:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921851648 00000100:00100000:2.0:1788941080.574960:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:2.0:1788941080.581940:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+18:18795:x1875839921851648:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788941080.582894:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+19:18795:x1875839921851648:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 7916us (12457us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788941080.582909:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 6 00000100:00100000:1.0:1788941080.637341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941080.637456:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921851904 00000100:00100000:2.0:1788941080.637480:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921851904 00000100:00100000:2.0:1788941080.637562:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:2.0:1788941080.637607:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+19:18798:x1875839921851904:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788941080.637634:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941080.637671:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf225 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7921 expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.638078:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf22c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.638091:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf22c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.638100:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf22c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941080.638108:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788941080.638207:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa000/0x9c34acc08badf225 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7921 expref: 22 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.638223:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf22c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7921 expref: 21 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.638229:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941080.638232:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788941080.638245:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fb800, rc 0) 00000100:00100000:2.0:1788941080.638361:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18798:x1875839921851904:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 789us (1030us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1788941080.638368:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 40 00000100:00100000:1.0:1788941080.642434:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.642612:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921852032 00000100:00100000:0.0:1788941080.642625:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921852032 00000100:00100000:2.0:1788941080.642707:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:2.0:1788941080.642722:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18798:x1875839921852032:12345-192.168.202.25@tcp:54:lfs.0 00010000:00010000:2.0:1788941080.642814:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.642840:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.642852:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643250:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643289:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643294:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643298:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fa800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:2.0:1788941080.643302:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643307:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643317:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941080.643319:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788941080.643323:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941080.643341:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa800/0x9c34acc08badf23a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941080.643406:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18798:x1875839921852032:12345-192.168.202.25@tcp:54:lfs.0 Request processed in 689us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.643412:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 41 00000100:00100000:3.0:1788941080.643493:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.643627:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921852160 00000100:00100000:0.0:1788941080.643634:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921852160 00000100:00100000:0.0:1788941080.643674:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:0.0:1788941080.643684:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:2405:x1875839921852160:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941080.643696:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941080.643711:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf22c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7921 expref: 21 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941080.643723:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941080.643727:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941080.643760:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b23480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+20:2405:x1875839921852160:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 78us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.643767:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:3.0:1788941080.650089:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941080.650231:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921852416 00000100:00100000:0.0:1788941080.650243:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921852416 00000100:00100000:0.0:1788941080.650343:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:0.0:1788941080.650355:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+20:18798:x1875839921852416:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:0.0:1788941080.650614:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18798:x1875839921852416:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 260us (535us total) trans 12884901901 rc 0/0 00000100:00100000:0.0:1788941080.650622:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 7 00000100:00100000:1.0:1788941080.733421:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945050496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941080.733508:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941080.733681:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945050496 00000100:00100000:0.0:1788941080.733690:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945050496 00000100:00100000:0.0:1788941080.733780:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788941080.733792:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945050496:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788941080.733826:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788941080.733876:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945050496:12345-0@lo:13:osp-pre-1-1.0 Request processed in 88us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.733884:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1788941080.733966:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941080.734006:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945050496:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788941080.734614:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788941080.735204:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945050752:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.735274:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941080.735323:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788941080.735330:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945050880:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.735357:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941080.735474:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945050880 00000100:00100000:2.0:1788941080.735480:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945050880 00000100:00100000:2.0:1788941080.735533:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788941080.735541:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945050880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.735603:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3647:x1875839945050880:12345-0@lo:400:kworker.0 Request processed in 63us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.735610:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788941080.735648:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3647:1875839945050880:0@lo:400:kworker.0 00000100:00100000:1.0:1788941080.736630:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945051008:0@lo:400:kworker.0 00000100:00100000:1.0:1788941080.736679:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941080.736703:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945050624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788941080.736726:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788941080.736774:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945050752 00000100:00100000:1.0:1788941080.736780:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945050752 00000100:00100000:1.0:1788941080.736819:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788941080.736827:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945050752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941080.736871:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945050752:12345-0@lo:400:kworker.0 Request processed in 45us (1596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941080.736889:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788941080.737081:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051008 00000100:00100000:0.0:1788941080.737086:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051008 00000100:00100000:0.0:1788941080.737146:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788941080.737154:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945051008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941080.737211:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945051008:12345-0@lo:400:kworker.0 Request processed in 58us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.737217:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788941080.737615:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941080.737652:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945051008:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.737732:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945050624 00000100:00100000:2.0:1788941080.737738:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945050624 00000100:00100000:2.0:1788941080.737789:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941080.737796:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945050624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788941080.737814:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941080.737858:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945050624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (1131us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.737872:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788941080.737904:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945050752:0@lo:400:kworker.0 00000100:00080000:1.0:1788941080.738010:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788941080.738039:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945050624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941080.738782:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.738822:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941080.738879:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.738906:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941080.738940:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051264 00000100:00100000:2.0:1788941080.738945:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051264 00000100:00100000:2.0:1788941080.738975:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788941080.738982:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945051264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.739022:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3647:x1875839945051264:12345-0@lo:400:kworker.0 Request processed in 41us (116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941080.739029:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788941080.739059:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3647:1875839945051264:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.739090:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945051392:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739463:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051136 00000100:00100000:3.0:1788941080.739468:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051136 00000100:00100000:3.0:1788941080.739503:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788941080.739511:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945051136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739546:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3646:x1875839945051136:12345-0@lo:400:kworker.0 Request processed in 36us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.739553:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788941080.739593:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945051520:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739620:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941080.739639:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945052032:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739684:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941080.739706:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788941080.739712:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945051648:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739733:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941080.739758:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051520 00000100:00100000:3.0:1788941080.739762:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051520 00000100:00100000:3.0:1788941080.739784:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945052032 00000100:00100000:3.0:1788941080.739786:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945052032 00000100:00100000:3.0:1788941080.739817:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051648 00000100:00100000:3.0:1788941080.739820:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051648 00000100:00100000:3.0:1788941080.739833:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941080.739838:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945051520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739874:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3645:x1875839945051520:12345-0@lo:400:kworker.0 Request processed in 35us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.739879:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941080.739892:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788941080.739897:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839945052032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739925:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b284700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3645:x1875839945052032:12345-0@lo:400:kworker.0 Request processed in 28us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.739931:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788941080.739941:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788941080.739947:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945051648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.739974:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b285c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3645:x1875839945051648:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.739979:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788941080.739997:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945051776:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740019:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941080.740036:0:3647:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788941080.740041:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945051904:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740061:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941080.740083:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051776 00000100:00100000:3.0:1788941080.740086:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051776 00000100:00100000:3.0:1788941080.740102:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051904 00000100:00100000:3.0:1788941080.740105:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051904 00000100:00100000:3.0:1788941080.740132:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788941080.740143:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945051776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740173:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b285180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3647:x1875839945051776:12345-0@lo:400:kworker.0 Request processed in 30us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.740178:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788941080.740190:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788941080.740195:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945051904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740218:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b285f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3647:x1875839945051904:12345-0@lo:400:kworker.0 Request processed in 23us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941080.740223:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788941080.740253:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b21500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3647:1875839945051904:0@lo:400:kworker.0 00010000:00080000:3.0:1788941080.740308:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005b21880 x1875839945051776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941080.740318:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3647:1875839945051776:0@lo:400:kworker.0 00000100:00080000:3.0:1788941080.740338:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788941080.740342:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788941080.740356:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3645:1875839945051648:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740365:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3645:1875839945051520:0@lo:400:kworker.0 00010000:00080000:3.0:1788941080.740373:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005b23b80 x1875839945052032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941080.740381:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3645:1875839945052032:0@lo:400:kworker.0 00000100:00100000:3.0:1788941080.740418:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3646:1875839945051136:0@lo:400:kworker.0 00000100:00100000:2.0:1788941080.741144:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941080.741308:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945051392 00000100:00100000:0.0:1788941080.741316:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945051392 00000100:00100000:0.0:1788941080.741373:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788941080.741380:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945051392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788941080.741435:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945051392:12345-0@lo:400:kworker.0 Request processed in 56us (2319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941080.741442:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941080.741648:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945051392:0@lo:400:kworker.0 00000100:00080000:3.0:1788941080.743743:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941081.002252:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941081.002368:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921852672 00000100:00100000:0.0:1788941081.002379:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921852672 00000100:00100000:0.0:1788941081.002475:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:0.0:1788941081.002487:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18829:x1875839921852672:12345-192.168.202.25@tcp:101:cat.0 00010000:00010000:0.0:1788941081.002514:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788941081.002516:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788941081.002536:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf241 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7928 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.002704:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf248 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.002720:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf248 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.002735:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf248 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941081.002748:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788941081.002880:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf241 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7928 expref: 24 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.002899:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf248 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7928 expref: 23 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.002908:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941081.002911:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788941081.002915:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0800, rc 0) 00000100:00100000:0.0:1788941081.002985:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b287480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+23:18829:x1875839921852672:12345-192.168.202.25@tcp:101:cat.0 Request processed in 500us (741us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788941081.002993:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 42 00000100:00100000:1.0:1788941081.007202:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941081.008073:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921852800 00000100:00100000:3.0:1788941081.008085:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921852800 00000100:00100000:3.0:1788941081.008326:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:3.0:1788941081.008338:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+23:2407:x1875839921852800:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941081.008355:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941081.008382:0:22713:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf248 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7928 expref: 23 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.008401:0:22713:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.008407:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788941081.008480:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+22:2407:x1875839921852800:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 144us (1289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941081.008488:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 1 00000100:00100000:1.0:1788941081.009771:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941081.009863:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921853056 00000100:00100000:2.0:1788941081.009871:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921853056 00000100:00100000:2.0:1788941081.009947:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:2.0:1788941081.010026:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+22:18829:x1875839921853056:12345-192.168.202.25@tcp:35:cat.0 00000100:00100000:2.0:1788941081.010667:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+23:18829:x1875839921853056:12345-192.168.202.25@tcp:35:cat.0 Request processed in 708us (898us total) trans 12884901903 rc 0/0 00000100:00100000:2.0:1788941081.010693:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 8 00000100:00100000:1.0:1788941081.132486:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941081.132583:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921853312 00000100:00100000:3.0:1788941081.132596:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921853312 00000100:00100000:3.0:1788941081.132664:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:3.0:1788941081.132674:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+23:18835:x1875839921853312:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1788941081.132699:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941081.132721:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf256 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc792f expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.132830:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badf25d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.132842:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badf25d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.132851:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badf25d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941081.132872:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788941081.132979:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf256 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc792f expref: 26 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.132998:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badf25d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc792f expref: 25 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.133007:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.133009:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788941081.133014:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602c00, rc 0) 00000100:00100000:3.0:1788941081.133077:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18835:x1875839921853312:12345-192.168.202.25@tcp:101:dd.0 Request processed in 405us (601us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1788941081.133084:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 43 00000100:00100000:1.0:1788941081.141787:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941081.141846:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941081.142632:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921853568 00000100:00100000:3.0:1788941081.142646:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921853568 00000100:00100000:3.0:1788941081.142715:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:3.0:1788941081.142726:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18835:x1875839921853568:12345-192.168.202.25@tcp:101:dd.0 00010000:00010000:3.0:1788941081.142752:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941081.142772:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf26b lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7936 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.142814:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.142831:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.142862:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.142982:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf26b lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 27 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.143000:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 26 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.143009:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.143011:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788941081.143016:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603000, rc 0) 00000100:00100000:3.0:1788941081.143087:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+26:18835:x1875839921853568:12345-192.168.202.25@tcp:101:dd.0 Request processed in 363us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941081.143095:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 44 00000100:00100000:0.0:1788941081.143301:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921853440 00000100:00100000:0.0:1788941081.143307:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921853440 00000100:00100000:0.0:1788941081.143340:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:0.0:1788941081.143348:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+26:2405:x1875839921853440:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941081.143357:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941081.143376:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602c00/0x9c34acc08badf25d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc792f expref: 26 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941081.143387:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941081.143391:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941081.143430:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:2405:x1875839921853440:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 82us (1667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941081.143438:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 2 00000100:00100000:1.0:1788941081.146682:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941081.154189:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921853824 00000100:00100000:2.0:1788941081.154205:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921853824 00000100:00100000:2.0:1788941081.154555:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 45 00000100:00100000:2.0:1788941081.155556:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18835:x1875839921853824:12345-192.168.202.25@tcp:36:dd.0 00010000:00010000:2.0:1788941081.155693:0:22729:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941081.155724:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb000/0x9c34acc08badf210 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7913 expref: 25 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941081.155744:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941081.155750:0:22729:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788941081.155920:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941081.155935:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941081.155946:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788941081.155987:0:22729:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1788941081.156007:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000470c9323 reply state 000000003b44f697 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941081.156019:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941081.156025:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941081.156028:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788941081.156043:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788941081.158964:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+27:18835:x1875839921853824:12345-192.168.202.25@tcp:36:dd.0 Request processed in 4386us (12279us total) trans 12884901906 rc 0/0 00000100:00100000:2.0:1788941081.158978:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 45 00000020:00080000:2.0:1788941081.158986:0:22729:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788941081.243465:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788941081.243489:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945052160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788941081.243600:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941081.243732:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945052160 00000100:00100000:2.0:1788941081.243741:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945052160 00000100:00100000:2.0:1788941081.243844:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788941081.243855:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945052160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788941081.243887:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788941081.243947:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945052160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941081.243955:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788941081.244030:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945052160:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788941081.270890:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941081.274495:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921854080 00000100:00100000:0.0:1788941081.274514:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921854080 00000100:00100000:0.0:1788941081.274674:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 9 00000100:00100000:0.0:1788941081.274685:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+27:18835:x1875839921854080:12345-192.168.202.25@tcp:35:dd.0 00000100:00100000:0.0:1788941081.274948:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+28:18835:x1875839921854080:12345-192.168.202.25@tcp:35:dd.0 Request processed in 264us (4073us total) trans 12884901907 rc 0/0 00000100:00100000:0.0:1788941081.274956:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 9 00010000:00010000:0.0:1788941081.499699:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941081.649361:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941081.649436:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921854208 00000100:00100000:3.0:1788941081.649445:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921854208 00000100:00100000:3.0:1788941081.649506:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:3.0:1788941081.649516:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+28:18849:x1875839921854208:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:3.0:1788941081.649543:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941081.649573:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf280 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc793d expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649662:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649703:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649715:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649726:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649733:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649739:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649816:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649824:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649832:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941081.649875:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788941081.649879:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941081.649916:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649929:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649947:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649953:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649960:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649966:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941081.649971:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649979:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.649991:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:3.0:1788941081.649994:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941081.649999:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650006:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf287 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650018:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650024:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650031:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650042:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941081.650046:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650053:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650061:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff91d005089c00) 00010000:00010000:3.0:1788941081.650063:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941081.650066:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650072:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf28e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650101:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf280 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc793d expref: 30 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650114:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc793d expref: 29 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.650839:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.650841:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788941081.650845:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603c00, rc 0) 00000100:00100000:3.0:1788941081.650928:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+29:18849:x1875839921854208:12345-192.168.202.25@tcp:101:stat.0 Request processed in 1411us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941081.650937:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 46 00000100:00100000:1.0:1788941081.790600:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941081.790732:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921854464 00000100:00100000:3.0:1788941081.790747:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921854464 00000100:00100000:3.0:1788941081.790801:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 47 00000100:00100000:3.0:1788941081.790811:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+29:18855:x1875839921854464:12345-192.168.202.25@tcp:36:truncate.0 00010000:00010000:3.0:1788941081.790870:0:24594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941081.790902:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf295 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc793d expref: 29 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.790922:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.790926:0:24594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788941081.791102:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.791133:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.791145:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788941081.791185:0:24594:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901908 00000004:00010000:3.0:1788941081.791206:0:24594:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ac4afc9c reply state 0000000051f1fb36 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.791218:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941081.791224:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941081.791227:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788941081.791230:0:24594:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788941081.791419:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+31:18855:x1875839921854464:12345-192.168.202.25@tcp:36:truncate.0 Request processed in 608us (826us total) trans 12884901909 rc 0/0 00000100:00100000:3.0:1788941081.791426:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 47 00000020:00080000:3.0:1788941081.791437:0:24594:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788941081.959187:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941081.959253:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921854592 00000100:00100000:1.0:1788941081.959304:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921854592 00000100:00100000:1.0:1788941081.959367:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 48 00000100:00100000:1.0:1788941081.959378:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+31:18869:x1875839921854592:12345-192.168.202.25@tcp:101:stat.0 00010000:00010000:1.0:1788941081.959405:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941081.959427:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6200/0x9c34acc08badf2a3 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7944 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959504:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959522:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959546:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959569:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959577:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959588:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959714:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959721:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959778:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941081.959815:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788941081.959818:0:22727:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788941081.959837:0:22727:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959846:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959853:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959864:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959869:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959873:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941081.959876:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959881:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959891:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:1.0:1788941081.959893:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941081.959897:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959901:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7e00/0x9c34acc08badf2aa lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959911:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959914:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959918:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959921:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941081.959926:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959931:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959935:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff91d005089c00) 00010000:00010000:1.0:1788941081.959936:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788941081.959938:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959941:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7400/0x9c34acc08badf2b1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959961:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6200/0x9c34acc08badf2a3 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 33 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959974:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 32 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941081.959981:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941081.959984:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788941081.959986:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7600, rc 0) 00000100:00100000:1.0:1788941081.960058:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+32:18869:x1875839921854592:12345-192.168.202.25@tcp:101:stat.0 Request processed in 681us (879us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941081.960065:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 48 00000040:00080000:2.0:1788941082.011906:0:23483:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788941082.023912:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941082.024237:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921854848 00000100:00100000:2.0:1788941082.024248:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921854848 00000100:00100000:2.0:1788941082.024343:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:2.0:1788941082.024353:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+32:18879:x1875839921854848:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:2.0:1788941082.024375:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941082.024395:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa600/0x9c34acc08badf2bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc794b expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788941082.024495:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788941082.024618:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa600/0x9c34acc08badf2bf lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc794b expref: 34 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.024659:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:2.0:1788941082.024662:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788941082.024668:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa600/0x9c34acc08badf2bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc794b expref: 34 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.024686:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fa600, rc 0) 00000100:00100000:2.0:1788941082.024757:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+33:18879:x1875839921854848:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 405us (912us total) trans 12884901910 rc 301/301 00000100:00100000:2.0:1788941082.024765:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 49 00000100:00100000:3.0:1788941082.029483:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941082.029566:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921855104 00000100:00100000:2.0:1788941082.029578:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921855104 00000100:00100000:2.0:1788941082.029680:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:2.0:1788941082.029692:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d042074450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+33:18879:x1875839921855104:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:2.0:1788941082.029940:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d042074450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+34:18879:x1875839921855104:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 250us (469us total) trans 12884901911 rc 0/0 00000100:00100000:2.0:1788941082.029948:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 10 00000100:00100000:1.0:1788941082.098383:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.098457:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921855360 00000100:00100000:3.0:1788941082.098468:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921855360 00000100:00100000:3.0:1788941082.098519:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1788941082.098527:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+34:18885:x1875839921855360:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:3.0:1788941082.098548:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941082.098575:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf2cd lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7952 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098685:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098698:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098703:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 35 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098709:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098786:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 35 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098796:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 35 pid: 22727 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941082.098805:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945052288:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788941082.098901:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.098911:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941082.098919:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b285880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945052416:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788941082.098937:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07bebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788941082.102108:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b286d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945052288:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788941082.102329:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b285880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945052416:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788941082.102357:0:22728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941082.103809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941082.103895:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.104315:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921855488 00000100:00100000:3.0:1788941082.104325:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921855488 00010000:00010000:3.0:1788941082.104366:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 36 pid: 22727 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941082.104422:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921855616 00000100:00100000:3.0:1788941082.104425:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921855616 00010000:00010000:3.0:1788941082.104433:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 37 pid: 22729 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941082.104523:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788941082.104533:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07a62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:2404:x1875839921855488:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941082.104565:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941082.104573:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 37 pid: 22727 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104591:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 37 pid: 22727 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941082.104599:0:22712:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788941082.104615:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2b8 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7944 expref: 37 pid: 22727 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104631:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.104636:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104646:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104653:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941082.104665:0:22712:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1788941082.104710:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07a62050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+36:2404:x1875839921855488:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 178us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.104718:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 17 00000100:00100000:1.0:1788941082.104765:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 18 00000100:00100000:1.0:1788941082.104772:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+35:2404:x1875839921855616:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788941082.104780:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788941082.104785:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104805:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104817:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf1fb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc790c expref: 35 pid: 22729 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104827:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.104831:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104838:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104846:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104871:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941082.104892:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+34:2404:x1875839921855616:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 120us (997us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.104898:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 18 00010000:00010000:1.0:1788941082.104930:0:22728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.104939:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941082.104958:0:22728:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788941082.105101:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603c00/0x9c34acc08badf2cd lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 35 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.105130:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 34 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.105137:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.105140:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788941082.105142:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602200, rc 0) 00000100:00100000:1.0:1788941082.105166:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+34:18885:x1875839921855360:12345-192.168.202.25@tcp:101:bash.0 Request processed in 6640us (6794us total) trans 12884901912 rc 0/0 00000100:00100000:1.0:1788941082.105173:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 50 00000100:00100000:3.0:1788941082.107880:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941082.107979:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921855872 00000100:00100000:0.0:1788941082.107990:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921855872 00000100:00100000:0.0:1788941082.108050:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 51 00000100:00100000:0.0:1788941082.108060:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+34:18885:x1875839921855872:12345-192.168.202.25@tcp:36:bash.0 00010000:00010000:0.0:1788941082.108312:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.108341:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.108350:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788941082.108387:0:24594:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000004:00010000:0.0:1788941082.108404:0:24594:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e75b73d0 reply state 00000000e5867014 transno 12884901914 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.108413:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.108418:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941082.108420:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941082.108424:0:24594:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788941082.108496:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b285880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18885:x1875839921855872:12345-192.168.202.25@tcp:36:bash.0 Request processed in 438us (626us total) trans 12884901914 rc 0/0 00000100:00100000:0.0:1788941082.108501:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 51 00000020:00080000:0.0:1788941082.108505:0:24594:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788941082.110814:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941082.110926:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856000 00000100:00100000:1.0:1788941082.110936:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856000 00000100:00100000:1.0:1788941082.111032:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:1.0:1788941082.111041:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18885:x1875839921856000:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:1.0:1788941082.111061:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941082.111076:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2e9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7959 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.111180:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2e9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7959 expref: 38 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.111191:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2e9 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7959 expref: 38 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.111206:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.111209:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788941082.111223:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f7600, rc 0) 00000100:00100000:1.0:1788941082.111342:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18885:x1875839921856000:12345-192.168.202.25@tcp:101:bash.0 Request processed in 298us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.111350:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 52 00000100:00100000:3.0:1788941082.115341:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941082.115399:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856128 00000100:00100000:2.0:1788941082.115411:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856128 00000100:00100000:2.0:1788941082.115463:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:2.0:1788941082.115474:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18885:x1875839921856128:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:2.0:1788941082.115493:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788941082.115512:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa200/0x9c34acc08badf2f0 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7960 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.115722:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.115746:0:22729:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 39 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.115753:0:22729:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.115781:0:22729:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 39 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941082.115790:0:22729:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 39 pid: 22728 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941082.115800:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875839945052544:192.168.202.25@tcp:104: 00000100:00100000:2.0:1788941082.115948:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07e8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788941082.118251:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.118310:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22729:1875839945052544:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788941082.118344:0:22729:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941082.118435:0:22712:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856256 00000100:00100000:0.0:1788941082.118442:0:22712:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856256 00010000:00010000:0.0:1788941082.118474:0:22712:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 40 pid: 22728 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941082.118507:0:22712:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 19 00000100:00100000:0.0:1788941082.118515:0:22712:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+40:2405:x1875839921856256:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941082.118531:0:22712:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941082.118538:0:22712:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 40 pid: 22728 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118570:0:22712:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 40 pid: 22728 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118599:0:22712:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602200/0x9c34acc08badf2d4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7952 expref: 40 pid: 22728 timeout: 937 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118616:0:22712:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941082.118621:0:22712:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118630:0:22712:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118638:0:22712:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.118767:0:22712:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941082.118827:0:22712:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020afaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+39:2405:x1875839921856256:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 311us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941082.118835:0:22712:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 19 00010000:00010000:3.0:1788941082.120204:0:22729:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.120214:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941082.120375:0:22729:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788941082.120379:0:22729:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941082.120400:0:22729:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.120426:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa200/0x9c34acc08badf2f0 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7960 expref: 39 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.120439:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7960 expref: 38 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941082.120444:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941082.120446:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788941082.120448:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91cf060fbc00, rc 0) 00000100:00100000:3.0:1788941082.120494:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b286d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18885:x1875839921856128:12345-192.168.202.25@tcp:101:bash.0 Request processed in 5022us (5159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941082.120506:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 53 00000100:00100000:2.0:1788941082.123989:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941082.124433:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856512 00000100:00100000:1.0:1788941082.124444:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856512 00000100:00100000:1.0:1788941082.124528:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1788941082.124539:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18885:x1875839921856512:12345-192.168.202.25@tcp:103:bash.0 00010000:00010000:1.0:1788941082.124565:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788941082.124590:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7600/0x9c34acc08badf2e9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7959 expref: 38 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.124611:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fbc00/0x9c34acc08badf2f7 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7960 expref: 37 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.124620:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.124625:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788941082.124685:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d020af9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+36:18885:x1875839921856512:12345-192.168.202.25@tcp:103:bash.0 Request processed in 144us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.124693:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 3 00000100:00100000:1.0:1788941082.127125:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.127166:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856640 00000100:00100000:3.0:1788941082.127175:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856640 00000100:00100000:1.0:1788941082.127563:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:1.0:1788941082.127577:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+36:18885:x1875839921856640:12345-192.168.202.25@tcp:58:bash.0 00010000:00010000:1.0:1788941082.127699:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.127716:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.128038:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788941082.131792:0:22727:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788941082.131853:0:22727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:1.0:1788941082.132173:0:22727:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:1.0:1788941082.132709:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+36:18885:x1875839921856640:12345-192.168.202.25@tcp:58:bash.0 Request processed in 5125us (5587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.132727:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 54 00000100:00100000:2.0:1788941082.139032:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941082.139144:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856768 00000100:00100000:0.0:1788941082.139300:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856768 00000100:00100000:0.0:1788941082.139376:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:0.0:1788941082.139384:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+36:18885:x1875839921856768:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788941082.139402:0:24594:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941082.139420:0:24594:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7967 expref: -99 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139484:0:24594:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139502:0:24594:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 37 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139523:0:24594:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139535:0:24594:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 37 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139561:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941082.139565:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788941082.139568:0:24594:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 37 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.139576:0:24594:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0200, rc 0) 00000100:00100000:0.0:1788941082.139654:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18885:x1875839921856768:12345-192.168.202.25@tcp:101:bash.0 Request processed in 269us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941082.139661:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 55 00000100:00100000:2.0:1788941082.267627:0:3648:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788941082.267656:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945052672:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788941082.267762:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941082.267821:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0928c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945052800:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788941082.267850:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941082.267959:0:3646:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788941082.268052:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945052672 00000100:00100000:1.0:1788941082.268060:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945052672 00000100:00100000:1.0:1788941082.268104:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788941082.268111:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945052672:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788941082.268147:0:23667:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1788941082.268357:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945052928:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788941082.268424:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941082.268472:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945052928 00000100:00100000:3.0:1788941082.268475:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945052928 00000100:00100000:1.0:1788941082.268825:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945052672:12345-0@lo:41:osp-pre-0-1.0 Request processed in 714us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941082.268832:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788941082.268955:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945052800 00000100:00100000:0.0:1788941082.268960:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945052800 00000100:00100000:2.0:1788941082.269040:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08dd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945052672:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788941082.270314:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788941082.270323:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945052800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788941082.270342:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788941082.270405:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945052800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (2553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941082.270423:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788941082.270474:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0928c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945052800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788941082.273078:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788941082.273095:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945052928:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788941082.273131:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788941082.273218:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b285500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945052928:12345-0@lo:41:osp-pre-1-0.0 Request processed in 131us (4793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941082.273223:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788941082.273284:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b287b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945052928:0@lo:41:osp-pre-1-0.0 00000100:00080000:1.0:1788941082.276879:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788941082.528121:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941082.973514:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941082.973523:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788941082.973563:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788941082.973573:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788941082.973727:0:22764:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b287b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22764:1875839945053056:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788941082.975012:0:22764:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07beb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788941082.982135:0:22764:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b287b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22764:1875839945053056:192.168.202.25@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788941082.983105:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.983199:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921856896 00000100:00100000:3.0:1788941082.983207:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921856896 00000100:00100000:3.0:1788941082.983328:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:3.0:1788941082.983339:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18886:x1875839921856896:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788941082.983411:0:22728:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788941082.983532:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18886:x1875839921856896:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 195us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941082.983538:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 56 00000100:00100000:2.0:1788941082.987187:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941082.987289:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921857024 00000100:00100000:0.0:1788941082.987299:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921857024 00000100:00100000:0.0:1788941082.987356:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:0.0:1788941082.987368:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18886:x1875839921857024:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788941082.987442:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987460:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987475:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987511:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987517:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987521:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987543:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987571:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987603:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788941082.987653:0:24594:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788941082.987658:0:24594:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788941082.987671:0:24594:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987681:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987686:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987693:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987697:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941082.987701:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987709:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987719:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:0.0:1788941082.987722:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941082.987726:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987732:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf30c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987756:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987760:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987765:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987769:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941082.987771:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987776:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987783:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff91d03ed37a00) 00010000:00010000:0.0:1788941082.987785:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941082.987787:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987792:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf313 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987805:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987810:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987815:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987824:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941082.987827:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987833:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987840:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941082.987842:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941082.987844:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941082.987849:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf31a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941082.987915:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18886:x1875839921857024:12345-192.168.202.25@tcp:34:lhsmtool_posix.0 Request processed in 549us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941082.987923:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 57 00000100:00100000:2.0:1788941082.991714:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941082.991781:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921857280 00000100:00100000:1.0:1788941082.991794:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921857280 00000100:00100000:1.0:1788941082.991918:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1788941082.991929:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+37:18886:x1875839921857280:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788941082.991949:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941082.992080:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6800/0x9c34acc08badf321 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc796e expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992526:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992559:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992583:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941082.992597:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788941082.992696:0:22727:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992705:0:22727:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992714:0:22727:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992721:0:22727:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:1.0:1788941082.992726:0:22727:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992735:0:22727:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992749:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:1.0:1788941082.992752:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788941082.992759:0:22727:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.992779:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf328 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.993630:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6800/0x9c34acc08badf321 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc796e expref: 39 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.993644:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d03ed37d00) 00010000:00010000:1.0:1788941082.993647:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788941082.993651:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6800/0x9c34acc08badf321 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc796e expref: 39 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941082.993663:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6800, rc 0) 00000100:00100000:1.0:1788941082.993736:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18886:x1875839921857280:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1808us (2029us total) trans 12884901915 rc 301/301 00000100:00100000:1.0:1788941082.993745:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 58 00000100:00100000:1.0:1788941082.998496:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941082.998585:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921857408 00000100:00100000:3.0:1788941082.998611:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921857408 00000100:00100000:3.0:1788941082.998673:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:3.0:1788941082.998683:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18886:x1875839921857408:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788941082.998727:0:22729:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788941082.998931:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18886:x1875839921857408:12345-192.168.202.25@tcp:53:lhsmtool_posix.0 Request processed in 249us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941082.998939:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 59 00000100:00100000:2.0:1788941083.007523:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941083.007975:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921857664 00000100:00100000:1.0:1788941083.007985:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921857664 00000100:00080000:0.0:1788941083.008044:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788941083.008059:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:1.0:1788941083.008071:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+38:18886:x1875839921857664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788941083.008092:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941083.008120:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6800/0x9c34acc08badf336 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7975 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788941083.008518:0:22728:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x23:0x0], count =31 00000004:00080000:1.0:1788941083.008523:0:22728:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x23:0x0]+31 in llog 00000004:00080000:1.0:1788941083.008558:0:22728:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:1.0:1788941083.008996:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf33d lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.009012:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf33d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.009025:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf33d lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.009085:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6800/0x9c34acc08badf336 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7975 expref: 41 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.009193:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf33d lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7975 expref: 40 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.009203:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91cf06dfd800) 00010000:00010000:1.0:1788941083.009206:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788941083.009209:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6400, rc 0) 00000100:00100000:1.0:1788941083.009427:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08dcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+40:18886:x1875839921857664:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 1357us (1914us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788941083.009435:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 60 00000100:00100000:2.0:1788941083.015024:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.015075:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921857920 00000100:00100000:0.0:1788941083.015087:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921857920 00000100:00100000:0.0:1788941083.015682:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:0.0:1788941083.015695:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+40:18886:x1875839921857920:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788941083.015758:0:24594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941083.015786:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6400/0x9c34acc08badf33d lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7975 expref: 40 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015807:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91cf06dfd800) 00010000:00010000:0.0:1788941083.015831:0:24594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941083.015854:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015869:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015880:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015893:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015900:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015906:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015948:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.015957:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016126:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016134:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.016138:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016146:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016215:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941083.016217:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.016222:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016229:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf34b lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016239:0:24594:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016245:0:24594:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016251:0:24594:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016274:0:24594:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1c00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.016277:0:24594:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016284:0:24594:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016291:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xa06fbfbb (ffff91d03ed37a00) 00010000:00010000:0.0:1788941083.016293:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.016295:0:24594:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.016300:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf352 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0xa06fbfbb bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.016402:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+39:18886:x1875839921857920:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 710us (1387us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788941083.016410:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 61 00000100:00100000:2.0:1788941083.025597:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.026419:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921858048 00000100:00100000:0.0:1788941083.026432:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921858048 00000100:00100000:0.0:1788941083.026503:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:0.0:1788941083.026512:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+39:18886:x1875839921858048:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788941083.026534:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941083.026579:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf359 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc797c expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026627:0:22727:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08badf360 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026643:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08badf360 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026656:0:22727:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08badf360 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026780:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0800/0x9c34acc08badf359 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc797c expref: 41 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026800:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d000/0x9c34acc08badf360 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc797c expref: 40 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.026809:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.026817:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788941083.026821:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d000, rc 0) 00000100:00100000:0.0:1788941083.026887:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+40:18886:x1875839921858048:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 376us (1303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.026894:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 62 00000100:00100000:2.0:1788941083.030995:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.031062:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921858304 00000100:00100000:3.0:1788941083.031070:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921858304 00000100:00100000:3.0:1788941083.031121:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:3.0:1788941083.031131:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+40:18886:x1875839921858304:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788941083.031215:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.031232:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.031246:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788941083.031425:0:22729:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:3.0:1788941083.031432:0:22729:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 838364174254ns, next at 839364172672ns, rc = 0 00000004:00010000:3.0:1788941083.031478:0:22729:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d2f97ba reply state 00000000520bdc94 transno 12884901917 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.031491:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.031499:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:3.0:1788941083.031512:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788941083.031515:0:22729:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788941083.031671:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+42:18886:x1875839921858304:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 541us (681us total) trans 12884901917 rc 0/0 00000100:00100000:3.0:1788941083.031678:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 63 00000100:00100000:2.0:1788941083.035864:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.035993:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921858432 00000100:00100000:3.0:1788941083.036002:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921858432 00000100:00100000:3.0:1788941083.036064:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:3.0:1788941083.036074:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+42:18886:x1875839921858432:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788941083.036100:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941083.036133:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7983 expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.036211:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 43 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.036227:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 43 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.036248:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:3.0:1788941083.036251:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788941083.036285:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004603200, rc 0) 00000100:00100000:3.0:1788941083.036349:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+43:18886:x1875839921858432:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 276us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.036356:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 64 00000100:00100000:2.0:1788941083.047761:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.047888:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921858560 00000100:00100000:0.0:1788941083.047900:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921858560 00000100:00100000:0.0:1788941083.047984:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00100000:0.0:1788941083.047996:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2405:x1875839921858560:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788941083.048241:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d0065d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2405:x1875839921858560:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 248us (491us total) trans 12884901891 rc 0/0 00000100:00100000:0.0:1788941083.048247:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 25 00000100:00080000:1.0:1788941083.048475:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788941083.050839:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.050943:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921858816 00000100:00100000:0.0:1788941083.050954:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921858816 00000100:00100000:0.0:1788941083.051035:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:0.0:1788941083.051047:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+43:18886:x1875839921858816:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788941083.051333:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+44:18886:x1875839921858816:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 289us (501us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1788941083.051341:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 11 00000100:00100000:3.0:1788941083.056239:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.056626:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859072 00000100:00100000:0.0:1788941083.056639:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859072 00000100:00100000:0.0:1788941083.056711:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:0.0:1788941083.056723:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+44:18886:x1875839921859072:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788941083.056889:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b287b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+44:18886:x1875839921859072:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 168us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.056915:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 65 00000100:00100000:1.0:1788941083.060717:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.060814:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859200 00000100:00100000:3.0:1788941083.060826:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859200 00000100:00100000:3.0:1788941083.060952:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:3.0:1788941083.060963:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+44:18886:x1875839921859200:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788941083.060993:0:22728:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788941083.061015:0:22728:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602a00/0x9c34acc08badf375 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc798a expref: -99 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061085:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061101:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061124:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788941083.061180:0:22728:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788941083.061202:0:22728:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061229:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602a00/0x9c34acc08badf375 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc798a expref: 46 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061249:0:22728:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc798a expref: 45 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.061455:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:3.0:1788941083.061459:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788941083.061464:0:22728:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d004602600, rc 0) 00000100:00100000:3.0:1788941083.061533:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+45:18886:x1875839921859200:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 572us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.061562:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 66 00000100:00100000:2.0:1788941083.065809:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.065920:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859328 00000100:00100000:0.0:1788941083.065931:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859328 00000100:00100000:0.0:1788941083.066041:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:0.0:1788941083.066049:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d03f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+6:2404:x1875839921859328:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788941083.066065:0:24237:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941083.066082:0:24237:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7991 expref: -99 pid: 24237 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788941083.066117:0:24237:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa1131b, blocks: 0x0 00010000:00010000:0.0:1788941083.066137:0:24237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=838s v=(0 0) 00010000:00010000:0.0:1788941083.066142:0:24237:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941083.066196:0:24237:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 7 pid: 24237 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.066214:0:24237:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 7 pid: 24237 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.066224:0:24237:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584d800, rc 0) 00000100:00100000:0.0:1788941083.066404:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d03f8a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2404:x1875839921859328:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 356us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.066409:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 26 00000100:00100000:2.0:1788941083.076201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.076252:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859584 00000100:00100000:3.0:1788941083.076387:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859584 00000100:00100000:3.0:1788941083.078064:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:3.0:1788941083.078110:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+45:18886:x1875839921859584:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788941083.078279:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005046680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+45:18886:x1875839921859584:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 192us (2085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.078288:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 67 00000100:00100000:1.0:1788941083.084438:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.084747:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859712 00000100:00100000:0.0:1788941083.084760:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859712 00000100:00100000:0.0:1788941083.084895:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 68 00000100:00100000:0.0:1788941083.084904:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+45:18886:x1875839921859712:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788941083.088655:0:22707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901918 is committed 00000004:00080000:1.0:1788941083.088681:0:22707:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1788941083.088771:0:22707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:3.0:1788941083.088875:0:3632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.088891:0:3632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.088899:0:3632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.088907:0:3632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e1400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941083.088914:0:3632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.088923:0:3632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941083.088934:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945053184:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788941083.088938:0:3632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:3.0:1788941083.088941:0:3632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1788941083.088946:0:3632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.088964:0:3632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1400/0x9c34acc08badf199 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.088995:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089008:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089016:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089023:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060faa00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.089033:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941083.089035:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941083.089148:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945053184 00000100:00100000:3.0:1788941083.089158:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945053184 00010000:00010000:0.0:1788941083.089170:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089192:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff91d005089300) 00010000:00010000:0.0:1788941083.089195:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788941083.089217:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788941083.089228:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3646:x1875839945053184:12345-0@lo:2:osp-syn-0-0.0 00010000:00010000:0.0:1788941083.089297:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089307:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060faa00/0x9c34acc08badf145 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089334:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089342:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941083.089461:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+20:18886:x1875839921859712:12345-192.168.202.25@tcp:44:lhsmtool_posix.0 Request processed in 4554us (5029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941083.089471:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 68 00002000:00010000:3.0:1788941083.089539:0:24595:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788941083.089543:0:24595:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788941083.089557:0:24595:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788941083.089559:0:24595:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788941083 -> 1788941083 00002000:00010000:3.0:1788941083.089561:0:24595:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788941083.089601:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3646:x1875839945053184:12345-0@lo:2:osp-syn-0-0.0 Request processed in 375us (577us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788941083.089607:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788941083.089754:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089775:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fa400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.089780:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089788:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089800:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:0.0:1788941083.089802:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.089806:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089812:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fa400/0x9c34acc08badf14c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089831:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089838:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089844:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089849:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fb200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.089853:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089859:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089877:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff91d005089c00) 00010000:00010000:0.0:1788941083.089880:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.089884:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089890:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb200/0x9c34acc08badf1f4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089908:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089914:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089920:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089925:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91cf060fb800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.089928:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089934:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089942:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.089944:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.089947:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089952:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91cf060fb800/0x9c34acc08badf279 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089973:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089981:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089987:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.089992:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602400 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.089995:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090001:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090009:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.090011:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.090014:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090020:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602400/0x9c34acc08badf29c lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090032:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090038:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090045:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090069:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d02e8e0e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.090073:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090080:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090094:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.090096:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.090099:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090105:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0e00/0x9c34acc08badf2e2 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090119:0:3631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090124:0:3631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090131:0:3631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090136:0:3631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.090139:0:3631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090145:0:3631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090164:0:3631:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.090166:0:3631:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788941083.090169:0:3631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.090175:0:3631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf367 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788941083.090560:0:3646:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d005047100/2, rc 0, transno 12884901892 00000100:00100000:1.0:1788941083.090570:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3646:1875839945053184:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788941083.096968:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.097338:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921859840 00000100:00100000:0.0:1788941083.097369:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921859840 00000100:00100000:1.0:1788941083.097928:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:1.0:1788941083.097941:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2405:x1875839921859840:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788941083.098091:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005047800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2405:x1875839921859840:12345-192.168.202.25@tcp:16:lhsmtool_posix.0 Request processed in 150us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941083.098100:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:2.0:1788941083.102610:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.102766:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860096 00000100:00100000:0.0:1788941083.102778:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860096 00000100:00100000:0.0:1788941083.102843:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:0.0:1788941083.102854:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+14:18886:x1875839921860096:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788941083.102905:0:24594:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941083.102932:0:24594:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf37c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc798a expref: 14 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.102951:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.102956:0:24594:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941083.104772:0:24594:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badf38a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.104793:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badf38a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.104803:0:24594:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badf38a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788941083.105017:0:24594:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000208f6638 reply state 00000000a6fd7a52 transno 12884901919 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badf38a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.105028:0:24594:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584c800/0x9c34acc08badf38a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 24594 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.105033:0:24594:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.105035:0:24594:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788941083.105038:0:24594:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788941083.105987:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:18886:x1875839921860096:12345-192.168.202.25@tcp:36:lhsmtool_posix.0 Request processed in 3126us (3381us total) trans 12884901919 rc 0/0 00000100:00100000:2.0:1788941083.105996:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 69 00000100:00100000:2.0:1788941083.108389:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.108430:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860224 00000100:00100000:0.0:1788941083.108440:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860224 00000100:00100000:0.0:1788941083.108490:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788941083.108499:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18886:x1875839921860224:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788941083.108518:0:24236:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941083.108536:0:24236:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc7998 expref: -99 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.108612:0:24236:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.108622:0:24236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941083.108626:0:24236:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941083.108632:0:24236:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.108671:0:24236:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.108698:0:24236:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.108713:0:24236:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24236:1875839945053312:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788941083.108805:0:24236:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00b35ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941083.111104:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.111211:0:24236:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:24236:1875839945053312:192.168.202.25@tcp:104: 00010000:00010000:0.0:1788941083.111243:0:24236:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 3/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.111292:0:24236:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d03584ca00, rc 0) 00000100:00100000:0.0:1788941083.111345:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:18886:x1875839921860224:12345-192.168.202.25@tcp:101:lhsmtool_posix.0 Request processed in 2846us (2962us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.111355:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:2.0:1788941083.112200:0:25774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860352 00000100:00100000:2.0:1788941083.112210:0:25774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860352 00010000:00010000:2.0:1788941083.112248:0:25774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 938 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.112311:0:25774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:2.0:1788941083.112321:0:25774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2404:x1875839921860352:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941083.112335:0:25774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941083.112358:0:25774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.112388:0:25774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.112412:0:25774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000625d3f9a/0x9c34acc08badf383 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7991 expref: 8 pid: 24237 timeout: 938 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.112429:0:25774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941083.112433:0:25774:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788941083.112439:0:25774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 7 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.112451:0:25774:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 7 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.112489:0:25774:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 7 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.112505:0:25774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25774:1875839945053440:192.168.202.25@tcp:105: 00000100:00100000:2.0:1788941083.112704:0:25774:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07e8b000 going to sleep for 11 seconds 00000100:00100000:2.0:1788941083.116666:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941083.116711:0:25774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf08d71f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:25774:1875839945053440:192.168.202.25@tcp:105: 00010000:00010000:2.0:1788941083.116734:0:25774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788941083.116780:0:25774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2404:x1875839921860352:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 4462us (5685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941083.116809:0:25774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 20 00000100:00100000:0.0:1788941083.117756:0:24237:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860480 00000100:00100000:0.0:1788941083.117771:0:24237:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860480 00000100:00100000:0.0:1788941083.118240:0:24237:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:0.0:1788941083.118250:0:24237:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2404:x1875839921860480:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788941083.118430:0:24237:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788941083.118434:0:24237:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788941082 00002000:00010000:0.0:1788941083.118436:0:24237:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788941081 00002000:00010000:0.0:1788941083.118438:0:24237:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788941083 -> 1788941082 00002000:00010000:0.0:1788941083.118441:0:24237:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788941083.119230:0:24237:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d70700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2404:x1875839921860480:12345-192.168.202.25@tcp:2:lhsmtool_posix.0 Request processed in 978us (2569us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788941083.119254:0:24237:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:2.0:1788941083.121896:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.121948:0:24595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860608 00000100:00100000:3.0:1788941083.121957:0:24595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860608 00000100:00100000:3.0:1788941083.122004:0:24595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:3.0:1788941083.122013:0:24595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2404:x1875839921860608:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788941083.122059:0:24595:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.122075:0:24595:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.122081:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788941083.122094:0:24595:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788941083.122098:0:24595:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 4/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.122172:0:24595:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.122183:0:24595:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.122194:0:24595:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24595:1875839945053568:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788941083.122371:0:24595:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07bebf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788941083.124447:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.124518:0:22713:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860736 00000100:00100000:0.0:1788941083.124527:0:22713:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860736 00010000:00010000:0.0:1788941083.124573:0:22713:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 9 pid: 24236 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.124619:0:22713:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 21 00000100:00100000:0.0:1788941083.124628:0:22713:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:2405:x1875839921860736:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788941083.124642:0:22713:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788941083.124664:0:22713:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 5/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 9 pid: 24236 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.124676:0:22713:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 9 pid: 24236 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.124698:0:22713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788941083.124703:0:22713:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788941083.124709:0:22713:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.124719:0:22713:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 4/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.124739:0:22713:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788941083.124793:0:22713:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+9:2405:x1875839921860736:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 166us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.124883:0:22713:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 21 00010000:00010000:3.0:1788941083.125486:0:24595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff68f8f3/0x9c34acc08badf391 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7998 expref: 8 pid: 24236 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.125501:0:24595:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b284380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:24595:1875839945053568:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788941083.125516:0:24595:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125581:0:24595:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125591:0:24595:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125616:0:24595:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125625:0:24595:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125634:0:24595:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125640:0:24595:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602a00 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:2.0:1788941083.125644:0:24595:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125651:0:24595:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125661:0:24595:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.125675:0:24595:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000168bfa8b/0x9c34acc08badf398 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24595 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.125778:0:24595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:2404:x1875839921860608:12345-192.168.202.25@tcp:1:lhsmtool_posix.0 Request processed in 3766us (3889us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941083.125787:0:24595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 31 00000100:00100000:2.0:1788941083.127369:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.127416:0:22728:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921860992 00000100:00100000:3.0:1788941083.127428:0:22728:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921860992 00000100:00100000:3.0:1788941083.127479:0:22728:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 70 00000100:00100000:3.0:1788941083.127488:0:22728:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:18886:x1875839921860992:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788941083.127574:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.127602:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 15 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.127608:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.127635:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 15 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.127645:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 15 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.127656:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945053696:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788941083.127717:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91cf07bebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941083.130244:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.130446:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b284380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945053696:192.168.202.25@tcp:104: 00010000:00010000:3.0:1788941083.130467:0:22728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.130516:0:25774:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861120 00000100:00100000:2.0:1788941083.130523:0:25774:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861120 00010000:00010000:2.0:1788941083.130567:0:25774:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.130598:0:25774:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 22 00000100:00100000:2.0:1788941083.130608:0:25774:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+16:2404:x1875839921861120:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788941083.130622:0:25774:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788941083.130628:0:25774:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130641:0:25774:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130661:0:25774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603000/0x9c34acc08badf272 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7936 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130673:0:25774:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:2.0:1788941083.130689:0:25774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 15 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130696:0:25774:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130701:0:25774:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130705:0:25774:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788941083.130725:0:25774:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941083.130747:0:22728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.130754:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788941083.130810:0:25774:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:2404:x1875839921861120:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 203us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941083.130818:0:25774:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 22 00010000:00010000:0.0:1788941083.131036:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.131049:0:22728:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 15 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.131058:0:22728:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.131086:0:22728:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 15 pid: 22728 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.131100:0:22728:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 15 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.131113:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945053824:192.168.202.25@tcp:104: 00000100:00100000:0.0:1788941083.131168:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00b35a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788941083.133518:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.133556:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945053824:192.168.202.25@tcp:104: 00000100:00100000:3.0:1788941083.133577:0:22714:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861248 00010000:00010000:0.0:1788941083.133582:0:22728:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.133585:0:22714:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861248 00010000:00010000:3.0:1788941083.133619:0:22714:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.133653:0:22714:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 23 00000100:00100000:3.0:1788941083.133661:0:22714:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07a60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+16:2404:x1875839921861248:12345-192.168.202.25@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788941083.133675:0:22714:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788941083.133687:0:22714:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133695:0:22714:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133711:0:22714:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf36e lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7983 expref: 16 pid: 22728 timeout: 938 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133721:0:22714:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:3.0:1788941083.133724:0:22714:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133731:0:22714:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133736:0:22714:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.133753:0:22714:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788941083.133768:0:22728:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.133775:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.133842:0:22714:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07a60050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+15:2404:x1875839921861248:12345-192.168.202.25@tcp:103:ldlm_bl.0 Request processed in 182us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.133849:0:22714:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 23 00000001:00080000:0.0:1788941083.133889:0:22728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901920 00000001:00080000:0.0:1788941083.134245:0:22728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901921 00000001:00080000:0.0:1788941083.134308:0:22728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901922 00000100:00100000:0.0:1788941083.134382:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22728:1875839945053952:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788941083.134426:0:22728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941083.134454:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00b35aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788941083.134683:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945053952 00000100:00100000:3.0:1788941083.134689:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945053952 00000100:00100000:3.0:1788941083.134721:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788941083.134729:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22728:x1875839945053952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788941083.134822:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22728:x1875839945053952:12345-0@lo:1000:mdt00_001.0 Request processed in 93us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.134840:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788941083.134984:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22728:1875839945053952:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1788941083.135116:0:22728:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901923 00000100:00100000:0.0:1788941083.135148:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22728:1875839945054080:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788941083.135167:0:22728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941083.135186:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00b35a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788941083.135203:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054080 00000100:00100000:2.0:1788941083.135208:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054080 00000100:00100000:2.0:1788941083.135242:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788941083.135250:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22728:x1875839945054080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788941083.135373:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:22728:x1875839945054080:12345-0@lo:1000:mdt00_001.0 Request processed in 123us (203us total) trans 12884901894 rc 0/0 00000100:00100000:2.0:1788941083.135380:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788941083.135438:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:22728:1875839945054080:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1788941083.135461:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135467:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135472:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135476:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584dc00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.135483:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135489:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135499:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.135501:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788941083.135504:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135509:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584dc00/0x9c34acc08badf3a6 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135529:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135532:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135535:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135538:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f7800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.135540:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135543:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135561:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.135562:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788941083.135570:0:22728:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 18 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135577:0:22728:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 18 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135583:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 18 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.135617:0:22728:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e0200/0x9c34acc08badf305 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc7967 expref: 18 pid: 24594 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.135625:0:22728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945054208:192.168.202.25@tcp:105: 00000100:00100000:0.0:1788941083.135670:0:22728:0:(client.c:2716:ptlrpc_set_wait()) set ffff91d00b35af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788941083.137655:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941083.137731:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861376 00000100:00100000:2.0:1788941083.137740:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861376 00000100:00100000:2.0:1788941083.137814:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:2.0:1788941083.137822:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0928f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+19:18885:x1875839921861376:12345-192.168.202.25@tcp:49:bash.0 00000100:00100000:2.0:1788941083.137924:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0928f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+19:18885:x1875839921861376:12345-192.168.202.25@tcp:49:bash.0 Request processed in 104us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941083.137940:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 12 00000100:00100000:0.0:1788941083.138082:0:22728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf07ff1500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22728:1875839945054208:192.168.202.25@tcp:105: 00010000:00010000:0.0:1788941083.138108:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138115:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f7800/0x9c34acc08badf2fe lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 22727 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138141:0:22728:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138151:0:22728:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138159:0:22728:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138175:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138179:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138183:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138186:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d03584d800 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.138189:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138193:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138200:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.138202:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788941083.138204:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138207:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d03584d800/0x9c34acc08badf3ad lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138213:0:22728:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138217:0:22728:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138220:0:22728:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138226:0:22728:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603a00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:0.0:1788941083.138228:0:22728:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138232:0:22728:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138236:0:22728:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.138237:0:22728:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788941083.138239:0:22728:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.138242:0:22728:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603a00/0x9c34acc08badf39f lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22728 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788941083.138374:0:22728:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+18:18886:x1875839921860992:12345-192.168.202.25@tcp:57:lhsmtool_posix.0 Request processed in 10888us (11013us total) trans 12884901924 rc 0/0 00000100:00100000:0.0:1788941083.138380:0:22728:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 70 00000020:00080000:0.0:1788941083.138382:0:22728:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788941083.138540:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941083.138554:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788941083.138567:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788941083.138572:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788941083.140411:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.141384:0:24235:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861504 00000100:00100000:0.0:1788941083.141394:0:24235:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861504 00000100:00100000:0.0:1788941083.141437:0:24235:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:0.0:1788941083.141444:0:24235:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+7:18885:x1875839921861504:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788941083.141459:0:24235:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941083.141477:0:24235:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c9be7f3/0x9c34acc08badf3b4 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc799f expref: -99 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788941083.141497:0:24235:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa1131a, atime: 0x6aa11319, ctime: 0x6aa1131a, blocks: 0x0 00010000:00010000:0.0:1788941083.141524:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=838s v=(0 0) 00010000:00010000:0.0:1788941083.141528:0:24235:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788941083.141534:0:24235:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c9be7f3/0x9c34acc08badf3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc799f expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.141558:0:24235:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003c9be7f3/0x9c34acc08badf3b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc799f expref: 8 pid: 24235 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.141570:0:24235:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e0e00, rc 0) 00000100:00100000:0.0:1788941083.141631:0:24235:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b284380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:18885:x1875839921861504:12345-192.168.202.25@tcp:101:bash.0 Request processed in 185us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.141637:0:24235:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 32 00000100:00100000:3.0:1788941083.143227:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941083.143327:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861760 00000100:00100000:1.0:1788941083.143336:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861760 00000100:00100000:1.0:1788941083.143410:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 13 00000100:00100000:1.0:1788941083.143419:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d00b287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+18:18886:x1875839921861760:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788941083.143695:0:22731:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788941083.143728:0:22731:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901925 00010000:00010000:1.0:1788941083.143762:0:22731:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143777:0:22731:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143804:0:22731:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143812:0:22731:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143818:0:22731:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143825:0:22731:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.143844:0:22731:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788941083.143866:0:22715:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788941083.143873:0:22715:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.143879:0:22715:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d0027f6600 already unused, calling callback (ffffffffc0cda760) 00010000:00010000:0.0:1788941083.143882:0:22715:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.143890:0:22715:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.143902:0:22715:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff91d03ed37000) 00010000:00010000:0.0:1788941083.143905:0:22715:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788941083.143909:0:22715:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.143915:0:22715:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6600/0x9c34acc08badf3bb lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22731 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788941083.143932:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d00b287800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+20:18886:x1875839921861760:12345-192.168.202.25@tcp:35:lhsmtool_posix.0 Request processed in 514us (712us total) trans 12884901926 rc 0/0 00010000:00010000:0.0:1788941083.143934:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941083.143935:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941083.143937:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788941083.143939:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 13 00000020:00080000:1.0:1788941083.143944:0:22731:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788941083.144352:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941083.144379:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921861888 00000100:00100000:0.0:1788941083.144385:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921861888 00000100:00100000:0.0:1788941083.144418:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:0.0:1788941083.144424:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+20:18885:x1875839921861888:12345-192.168.202.25@tcp:101:bash.0 00010000:00010000:0.0:1788941083.144436:0:22729:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788941083.144448:0:22729:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf3c2 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc79a6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144475:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf3c9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144484:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf3c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144492:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf3c9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144592:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1c00/0x9c34acc08badf3c2 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc79a6 expref: 22 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144608:0:22729:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d02e8e1e00/0x9c34acc08badf3c9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc79a6 expref: 21 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788941083.144615:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:0.0:1788941083.144623:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788941083.144626:0:22729:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d02e8e1e00, rc 0) 00000100:00100000:0.0:1788941083.144654:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18885:x1875839921861888:12345-192.168.202.25@tcp:101:bash.0 Request processed in 229us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941083.144660:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 71 00000100:00100000:0.0:1788941083.149604:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:2.0:1788941083.149830:0:22730:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921862144 00000100:00100000:2.0:1788941083.149841:0:22730:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921862144 00000100:00100000:2.0:1788941083.149901:0:22730:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 14 00000100:00100000:2.0:1788941083.149912:0:22730:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+21:18885:x1875839921862144:12345-192.168.202.25@tcp:35:bash.0 00000001:00080000:2.0:1788941083.150235:0:22730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901927 00000001:00080000:2.0:1788941083.150323:0:22730:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901928 00000100:00100000:2.0:1788941083.150405:0:22730:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+24:18885:x1875839921862144:12345-192.168.202.25@tcp:35:bash.0 Request processed in 496us (812us total) trans 12884901929 rc 0/0 00000100:00100000:2.0:1788941083.150411:0:22730:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 14 00000020:00080000:2.0:1788941083.150415:0:22730:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788941083.197509:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941083.197588:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921862400 00000100:00100000:1.0:1788941083.197598:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921862400 00000100:00100000:1.0:1788941083.197650:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:1.0:1788941083.197657:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+24:18896:x1875839921862400:12345-192.168.202.25@tcp:101:lfs.0 00010000:00010000:1.0:1788941083.197682:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788941083.197699:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf3d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc3c960857cbc79ad expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788941083.197790:0:22727:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788941083.197879:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf3d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc79ad expref: 26 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.197905:0:22727:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91cf06dfde00) 00010000:00010000:1.0:1788941083.197907:0:22727:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788941083.197911:0:22727:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d0027f6a00/0x9c34acc08badf3d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.25@tcp remote: 0xc3c960857cbc79ad expref: 26 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788941083.197922:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d0027f6a00, rc 0) 00000100:00100000:1.0:1788941083.198084:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18896:x1875839921862400:12345-192.168.202.25@tcp:101:lfs.0 Request processed in 426us (581us total) trans 12884901930 rc 301/301 00000100:00100000:1.0:1788941083.198092:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 72 00000100:00100000:0.0:1788941083.199736:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941083.199786:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921862528 00000100:00100000:3.0:1788941083.199795:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921862528 00000100:00100000:3.0:1788941083.199841:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:3.0:1788941083.199847:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18896:x1875839921862528:12345-192.168.202.25@tcp:34:lfs.0 00010000:00010000:3.0:1788941083.199905:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/1,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.199918:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.199927:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.199937:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.199941:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.199945:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200028:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200050:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200057:0:22729:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788941083.200099:0:22729:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200109:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/1,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200113:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200118:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200121:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603200 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941083.200124:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200129:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200136:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff91d005089000) 00010000:00010000:3.0:1788941083.200138:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941083.200142:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200146:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603200/0x9c34acc08badf3de lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200162:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200166:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200169:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200172:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004603e00 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941083.200173:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200177:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200180:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff91cf07e65e00) 00010000:00010000:3.0:1788941083.200182:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941083.200183:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200186:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004603e00/0x9c34acc08badf3e5 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200196:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200199:0:22729:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200202:0:22729:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200209:0:22729:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d004602600 already unused, calling callback (ffffffffc18e84f0) 00010000:00010000:3.0:1788941083.200211:0:22729:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200214:0:22729:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200229:0:22729:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff91d005089b00) 00010000:00010000:3.0:1788941083.200231:0:22729:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788941083.200232:0:22729:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788941083.200236:0:22729:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d004602600/0x9c34acc08badf3ec lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22729 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788941083.200331:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18896:x1875839921862528:12345-192.168.202.25@tcp:34:lfs.0 Request processed in 482us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941083.200339:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:2.0:1788941083.201719:0:3639:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:1.0:1788941083.201759:0:22731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921862784 00000100:00100000:1.0:1788941083.201769:0:22731:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921862784 00000100:00100000:1.0:1788941083.201809:0:22731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 15 00000100:00100000:1.0:1788941083.201819:0:22731:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+25:18896:x1875839921862784:12345-192.168.202.25@tcp:35:lfs.0 00000100:00100000:1.0:1788941083.202052:0:22731:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08d72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+26:18896:x1875839921862784:12345-192.168.202.25@tcp:35:lfs.0 Request processed in 234us (336us total) trans 12884901931 rc 0/0 00000100:00100000:1.0:1788941083.202060:0:22731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 15 00010000:00010000:3.0:1788941083.547834:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788941084.189830:0:22764:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788941084.189842:0:22764:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788941084.189864:0:22764:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788941084.189874:0:22764:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1788941084.463025:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463122:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463159:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463182:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463201:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463220:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463238:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463275:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463301:0:3638:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941084.463328:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863424 00000100:00100000:0.0:1788941084.463340:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863424 00000100:00100000:0.0:1788941084.463393:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863936 00000100:00100000:0.0:1788941084.463396:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863936 00000100:00100000:0.0:1788941084.463408:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863296 00000100:00100000:0.0:1788941084.463409:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863296 00000100:00100000:0.0:1788941084.463419:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863808 00000100:00100000:0.0:1788941084.463421:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863808 00000100:00100000:0.0:1788941084.463455:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1788941084.463464:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2404:x1875839921863424:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463571:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2404:x1875839921863424:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 107us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463578:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 27 00000100:00100000:0.0:1788941084.463605:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1788941084.463611:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863936:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463635:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863936:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463641:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 28 00000100:00100000:0.0:1788941084.463652:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788941084.463658:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2404:x1875839921863296:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463679:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06f64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2404:x1875839921863296:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (441us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463685:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 29 00000100:00100000:0.0:1788941084.463695:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:0.0:1788941084.463700:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863808:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463721:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863808:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463726:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 30 00000100:00100000:0.0:1788941084.463748:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863168 00000100:00100000:0.0:1788941084.463752:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863168 00000100:00100000:0.0:1788941084.463772:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863680 00000100:00100000:0.0:1788941084.463774:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863680 00000100:00100000:0.0:1788941084.463784:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863040 00000100:00100000:0.0:1788941084.463787:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863040 00000100:00100000:0.0:1788941084.463796:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921863552 00000100:00100000:0.0:1788941084.463798:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921863552 00000100:00100000:0.0:1788941084.463812:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1788941084.463817:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2404:x1875839921863168:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463842:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+5:2404:x1875839921863168:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463856:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 73 00000100:00100000:0.0:1788941084.463869:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:0.0:1788941084.463874:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863680:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463898:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+5:2404:x1875839921863680:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463904:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 74 00000100:00100000:0.0:1788941084.463915:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:0.0:1788941084.463922:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+26:2404:x1875839921863040:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463946:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf07ff3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a59a807-509a-4dc3-9d2e-9cc836e430e2+26:2404:x1875839921863040:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 26us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463952:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 75 00000100:00100000:0.0:1788941084.463962:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:0.0:1788941084.463968:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2404:x1875839921863552:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:0.0:1788941084.463989:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d001378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:a21cd3f3-8c72-4460-9f1e-22e6666edfab+6:2404:x1875839921863552:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 22us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941084.463995:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 76 00000100:00100000:1.0:1788941084.464464:0:22722:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921862912 00000100:00100000:1.0:1788941084.464470:0:22722:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921862912 00000100:00100000:1.0:1788941084.464552:0:22722:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00100000:1.0:1788941084.464560:0:22722:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:2404:x1875839921862912:12345-192.168.202.25@tcp:400:kworker.0 00000100:00100000:1.0:1788941084.464602:0:22722:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1db1d5c3-15ff-40cf-9be9-426f5189bac6+13:2404:x1875839921862912:12345-192.168.202.25@tcp:400:kworker.0 Request processed in 44us (1585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788941084.464608:0:22722:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 170 00000100:00080000:1.0:1788941084.464956:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788941084.464967:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788941084.464969:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788941084.464972:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:2.0:1788941084.469733:0:25811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: /mnt/lustre/d1d.sanity-pcc/f1d.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788941084.571777:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788941085.595567:0:22716:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788941085.851773:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.851877:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.851922:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945055104:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.851946:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.851981:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945055616:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852048:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.852082:0:3645:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788941085.852089:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852131:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.852154:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945055232:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852178:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.852193:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839945055744:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852215:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.852295:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054592 00000100:00100000:3.0:1788941085.852306:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054592 00000100:00100000:3.0:1788941085.852371:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055104 00000100:00100000:3.0:1788941085.852375:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055104 00000100:00100000:3.0:1788941085.852391:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054720 00000100:00100000:3.0:1788941085.852393:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054720 00000100:00100000:3.0:1788941085.852405:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055232 00000100:00100000:3.0:1788941085.852408:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055232 00000100:00100000:3.0:1788941085.852426:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788941085.852435:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839945054592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852502:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b23800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3645:x1875839945054592:12345-0@lo:400:kworker.0 Request processed in 68us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852511:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788941085.852539:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788941085.852546:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945055104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852574:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945055104:12345-0@lo:400:kworker.0 Request processed in 29us (627us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852580:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788941085.852591:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788941085.852607:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945054720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852638:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3645:x1875839945054720:12345-0@lo:400:kworker.0 Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852645:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788941085.852656:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941085.852661:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945055232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852688:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945055232:12345-0@lo:400:kworker.0 Request processed in 26us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852694:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788941085.852718:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055616 00000100:00100000:3.0:1788941085.852723:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055616 00000100:00100000:3.0:1788941085.852753:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055744 00000100:00100000:3.0:1788941085.852756:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055744 00000100:00100000:3.0:1788941085.852777:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788941085.852784:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91d005b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945055616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852815:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91d005b21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3645:x1875839945055616:12345-0@lo:400:kworker.0 Request processed in 32us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852822:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788941085.852834:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788941085.852840:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839945055744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852866:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3645:x1875839945055744:12345-0@lo:400:kworker.0 Request processed in 26us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.852872:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788941085.852934:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b284000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945054720:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852945:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020afaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945055232:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852966:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b23b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3645:1875839945055744:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852978:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b284e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3645:1875839945054592:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.852988:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b287100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945055104:0@lo:400:kworker.0 00010000:00080000:3.0:1788941085.853000:0:3645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005b22d80 x1875839945055616/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788941085.853011:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3645:1875839945055616:0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.853323:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945054464:0@lo:400:kworker.0 00000100:00100000:1.0:1788941085.853323:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945054336:0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.859072:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941085.859199:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945054976:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.859289:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054464 00000100:00100000:3.0:1788941085.859311:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054464 00000100:00100000:2.0:1788941085.859328:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941085.859348:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839945055488:0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.859372:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788941085.859404:0:3648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0784f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945056000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941085.859418:0:23667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054976 00000100:00100000:2.0:1788941085.859425:0:3648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.859426:0:23667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054976 00000100:00100000:3.0:1788941085.859466:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788941085.859490:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945056000 00000100:00100000:3.0:1788941085.859491:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945054464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.859503:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945056000 00000100:00100000:2.0:1788941085.859573:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788941085.859604:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945056000:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788941085.859618:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945054464:12345-0@lo:400:kworker.0 Request processed in 140us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.859632:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00002000:00000024:2.0:1788941085.859649:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788941085.859662:0:23667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941085.859670:0:23667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945054976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788941085.859877:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.863822:0:23667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3648:x1875839945054976:12345-0@lo:400:kworker.0 Request processed in 4137us (4480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.863848:0:23667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788941085.863953:0:24594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055488 00000100:00100000:3.0:1788941085.863978:0:24594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055488 00000100:00100000:3.0:1788941085.864053:0:24594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788941085.864062:0:24594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839945055488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.864307:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06101c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3648:x1875839945056000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4657us (4831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941085.864325:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788941085.865494:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0784f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945056000:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788941085.865513:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b284a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3648:1875839945054464:0@lo:400:kworker.0 00000100:00100000:2.0:1788941085.865572:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b286300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3648:1875839945054976:0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.866467:0:24594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf06103100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3648:x1875839945055488:12345-0@lo:400:kworker.0 Request processed in 2333us (7020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.866480:0:24594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788941085.866593:0:3648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3648:1875839945055488:0@lo:400:kworker.0 00000100:00080000:2.0:1788941085.868362:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788941085.868372:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788941085.868376:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788941085.868379:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788941085.870629:0:22721:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054336 00000100:00100000:3.0:1788941085.870644:0:22721:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054336 00000100:00100000:3.0:1788941085.870723:0:22721:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788941085.870735:0:22721:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945054336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.870860:0:22721:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:66773969-0b9c-4025-866a-db20e971736d+24:3647:x1875839945054336:12345-0@lo:400:kworker.0 Request processed in 128us (10984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.870868:0:22721:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788941085.871310:0:3645:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0784ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945056128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941085.871367:0:3645:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.871579:0:24239:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945056128 00000100:00100000:3.0:1788941085.871585:0:24239:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945056128 00000100:00100000:3.0:1788941085.871630:0:24239:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788941085.871639:0:24239:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945056128:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788941085.871663:0:24239:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788941085.881646:0:24239:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3645:x1875839945056128:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9991us (10261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788941085.881668:0:24239:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788941085.881819:0:3645:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0784ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3645:1875839945056128:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788941085.891481:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b286a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:66773969-0b9c-4025-866a-db20e971736d:3647:1875839945054336:0@lo:400:kworker.0 00000100:00100000:0.0:1788941085.891504:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d00b286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945054848:0@lo:400:kworker.0 00000100:00100000:0.0:1788941085.891638:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941085.891677:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945055360:0@lo:400:kworker.0 00000100:00100000:0.0:1788941085.891699:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788941085.891727:0:3647:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91d005b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945055872:0@lo:400:kworker.0 00000100:00100000:0.0:1788941085.891746:0:3647:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941085.891923:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945054848 00000100:00100000:3.0:1788941085.891933:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945054848 00000100:00100000:3.0:1788941085.891995:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055360 00000100:00100000:3.0:1788941085.891999:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055360 00000100:00100000:3.0:1788941085.892011:0:22729:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945055872 00000100:00100000:3.0:1788941085.892013:0:22729:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945055872 00000100:00100000:3.0:1788941085.892053:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788941085.892062:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945054848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.892161:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3647:x1875839945054848:12345-0@lo:400:kworker.0 Request processed in 98us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.892175:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788941085.892195:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788941085.892201:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945055360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.892229:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3647:x1875839945055360:12345-0@lo:400:kworker.0 Request processed in 29us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.892235:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788941085.892245:0:22729:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788941085.892251:0:22729:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945055872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788941085.892305:0:22729:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf08c0f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3647:x1875839945055872:12345-0@lo:400:kworker.0 Request processed in 53us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941085.892311:0:22729:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:0.0:1788941085.896400:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788941085.896527:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d00b286680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3647:1875839945054848:0@lo:400:kworker.0 00000100:00100000:0.0:1788941085.896550:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d020af9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3647:1875839945055360:0@lo:400:kworker.0 00010000:00080000:0.0:1788941085.896571:0:3647:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff91d005b20380 x1875839945055872/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788941101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788941085.896585:0:3647:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91d005b20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3647:1875839945055872:0@lo:400:kworker.0 00000100:00100000:3.0:1788941086.364713:0:3646:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff91cf0784ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945056256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941086.364784:0:3646:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788941086.364842:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839945056256 00000100:00100000:3.0:1788941086.364850:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839945056256 00000100:00100000:3.0:1788941086.364895:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788941086.364903:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945056256:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788941086.364933:0:24238:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788941086.364974:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3646:x1875839945056256:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788941086.364982:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788941086.365028:0:3646:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff91cf0784ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3646:1875839945056256:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788941086.514446:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:3.0:1788941086.514492:0:3640:0:(events.c:344:request_in_callback()) peer: 12345-192.168.202.25@tcp (source: 12345-192.168.202.25@tcp) 00000100:00100000:0.0:1788941086.514648:0:24236:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921864192 00000100:00100000:0.0:1788941086.514659:0:24236:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921864192 00000100:00100000:0.0:1788941086.514734:0:24236:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00100000:0.0:1788941086.514747:0:24236:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2407:x1875839921864192:12345-192.168.202.25@tcp:16:kworker.0 00000100:00100000:0.0:1788941086.514878:0:24236:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2407:x1875839921864192:12345-192.168.202.25@tcp:16:kworker.0 Request processed in 132us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788941086.514886:0:24236:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 33 00000100:00080000:3.0:1788941086.515221:0:22723:0:(pinger.c:555:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788941086.515339:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875839921864064 00000100:00100000:1.0:1788941086.515345:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875839921864064 00002000:00100000:1.0:1788941086.515374:0:24240:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff91cf0784ce00 x1875839921864064/t0(0) o4->0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp:307/0 lens 504/0 e 0 to 0 dl 1788941097 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:1.0:1788941086.515384:0:24240:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf0784ce00 with x1875839921864064 ext(0->8) 00002000:00010000:1.0:1788941086.515389:0:24240:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf0784ce00 00000100:00100000:1.0:1788941086.515709:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.25@tcp, seq: 0 00000100:00100000:1.0:1788941086.515718:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff91cf0784ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+8:2407:x1875839921864064:12345-192.168.202.25@tcp:4:bash.0 00000100:00100000:2.0:1788941086.523083:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff91cf0784ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a59a807-509a-4dc3-9d2e-9cc836e430e2+10:2407:x1875839921864064:12345-192.168.202.25@tcp:4:bash.0 Request processed in 7354us (8578us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788941086.523103:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.25@tcp, seq: 0 00002000:00100000:2.0:1788941086.523116:0:24240:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x42:0x0] (0->8) req@ffff91cf0784ce00 x1875839921864064/t12884901895(0) o4->0a59a807-509a-4dc3-9d2e-9cc836e430e2@192.168.202.25@tcp:307/0 lens 504/448 e 0 to 0 dl 1788941097 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788941086.523127:0:24240:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff91cf0784ce00 with x1875839921864064 ext(0->8) 00002000:00010000:2.0:1788941086.523134:0:24240:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91cf0784ce00 00010000:00010000:3.0:1788941086.619626:0:22715:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14944 lines, 14944 kept, 0 dropped, 0 bad.